2024-09-15T22:41:39.968 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:41:39.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:41:40.080 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906279' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFj1TO2UBpCqylpl9bKZDFAXQK+2Ul1f2ybpAjkbOJ2FL+OrPLpfeuwwcOjkmQqxXfRAqC+1vmcgv4EyifVG2M= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGyPkbbcBknz/wqJF3+O5K6Vvkx9EdkFu+wt4EwvB6l7AgM6JVBMQjEf950XOibQk3edrsRbIaphHeDwQZRsoY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:41:40.080 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:41:40.081 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:41:40.081 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:41:40.082 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:41:40.103 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:41:40.103 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:41:40.103 INFO:teuthology.packaging:ref: None 2024-09-15T22:41:40.103 INFO:teuthology.packaging:tag: None 2024-09-15T22:41:40.103 INFO:teuthology.packaging:branch: squid 2024-09-15T22:41:40.103 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:41:40.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-15T22:41:40.316 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:41:40.318 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:41:40.443 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:41:40.443 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:41:40.731 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:41:40.762 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:41:40.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:41:40.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:36:15.052328', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAaqv0101fphOdWZCVncNkBUA5mg2Rdh+a5TC27cbF3Q'} 2024-09-15T22:41:40.818 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:36:15.053910', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERpGVPZgpHoAcumEPjcsL35KmFlLYv0lqFyg8i25lma'} 2024-09-15T22:41:40.818 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:41:40.824 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-15T22:41:40.824 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-15T22:41:40.824 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:41:40.882 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff81daf130>, signals=[15]) 2024-09-15T22:41:40.882 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:41:40.888 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:41:40.888 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:41:40.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:41:40.972 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:41:40.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:41:41.048 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:41:41.055 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-09-15T22:41:41.060 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-09-15T22:41:41.061 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-09-15T22:41:41.113 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T22:41:41.113 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Ubuntu" 2024-09-15T22:41:41.113 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="22.04" 2024-09-15T22:41:41.113 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T22:41:41.113 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_CODENAME=jammy 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:ID=ubuntu 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE=debian 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T22:41:41.114 INFO:teuthology.orchestra.run.smithi028.stdout:UBUNTU_CODENAME=jammy 2024-09-15T22:41:41.115 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-09-15T22:41:41.136 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-15T22:41:41.142 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-15T22:41:41.142 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-15T22:41:41.187 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T22:41:41.187 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-09-15T22:41:41.187 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T22:41:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-09-15T22:41:41.189 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-15T22:41:41.211 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:41:41.219 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:41:41.224 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:41:41.224 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:41:41.226 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:41:41.235 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:41:41.241 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:41:41.241 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:41:41.274 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:41:41.285 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:41:41.338 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:41:41.361 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:41:41.361 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T22:41:41.362 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:41:41.362 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:41:41.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:41.370 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-15T22:41:41.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:41:41.371 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-15T22:41:41.416 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-56-generic 2024-09-15T22:41:41.416 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.15.0-56-generic 2024-09-15T22:41:41.416 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-09-15T22:41:41.419 INFO:teuthology.orchestra.run.smithi028.stdout:5.15.0-56-generic 2024-09-15T22:41:41.419 INFO:teuthology.task.kernel:Running kernel on smithi028: 5.15.0-56-generic 2024-09-15T22:41:41.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get clean 2024-09-15T22:41:41.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2024-09-15T22:41:41.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-15T22:41:41.667 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T22:41:41.686 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:41:41.701 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T22:41:41.765 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T22:41:41.780 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:41:41.801 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T22:41:41.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T22:41:41.878 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T22:41:41.912 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T22:41:41.945 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T22:41:41.981 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T22:41:41.982 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T22:41:41.985 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T22:41:41.986 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T22:41:42.010 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T22:41:42.011 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T22:41:42.015 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T22:41:42.015 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T22:41:42.018 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T22:41:42.023 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T22:41:42.025 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T22:41:42.026 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T22:41:42.029 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T22:41:42.030 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T22:41:42.030 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T22:41:42.031 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T22:41:42.057 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T22:41:42.057 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T22:41:42.061 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T22:41:42.061 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T22:41:42.066 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T22:41:42.066 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T22:41:42.071 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T22:41:42.076 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T22:41:42.079 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T22:41:42.079 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T22:41:42.096 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T22:41:42.097 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T22:41:42.097 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T22:41:42.097 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T22:41:42.097 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T22:41:42.098 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T22:41:42.109 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T22:41:42.126 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T22:41:42.127 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T22:41:42.127 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T22:41:42.128 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T22:41:42.220 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T22:41:42.246 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T22:41:42.359 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T22:41:42.667 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T22:41:42.678 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T22:41:42.684 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T22:41:42.692 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T22:41:42.693 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T22:41:42.694 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T22:41:42.713 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T22:41:42.728 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T22:41:42.728 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T22:41:42.791 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T22:41:42.798 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T22:41:42.799 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T22:41:42.802 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T22:41:42.802 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T22:41:42.814 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T22:41:42.815 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T22:41:42.825 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T22:41:42.846 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T22:41:42.847 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T22:41:42.850 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T22:41:42.853 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T22:41:42.854 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T22:41:42.854 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T22:41:42.865 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T22:41:42.871 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T22:41:42.872 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T22:41:42.873 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T22:41:42.924 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T22:41:42.925 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T22:41:42.925 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T22:41:42.927 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T22:41:42.930 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T22:41:42.955 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T22:41:42.956 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T22:41:42.956 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T22:41:42.957 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T22:41:42.958 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T22:41:43.005 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T22:41:48.323 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 16.0 MB in 2s (7,579 kB/s) 2024-09-15T22:41:48.796 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 16.0 MB in 2s (7,377 kB/s) 2024-09-15T22:41:49.707 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:41:49.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T22:41:49.778 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:41:49.965 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-15T22:41:49.966 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-15T22:41:50.133 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:41:50.133 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:41:50.134 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:41:50.134 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:41:50.134 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T22:41:50.134 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-09-15T22:41:50.134 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:41:50.135 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-15T22:41:50.135 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T22:41:50.136 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T22:41:50.136 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T22:41:50.137 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-15T22:41:50.137 INFO:teuthology.orchestra.run.smithi131.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T22:41:50.137 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-09-15T22:41:50.137 INFO:teuthology.orchestra.run.smithi131.stdout: thermald 2024-09-15T22:41:50.182 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-15T22:41:50.182 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T22:41:50.182 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T22:41:50.182 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T22:41:50.183 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-09-15T22:41:50.184 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T22:41:50.231 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:41:50.234 INFO:teuthology.orchestra.run.smithi131.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T22:41:50.234 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 113 MB of archives. 2024-09-15T22:41:50.234 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T22:41:50.234 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T22:41:50.250 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T22:41:50.305 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:41:50.495 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-09-15T22:41:50.496 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-09-15T22:41:50.663 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T22:41:50.669 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout: python2.7-minimal 2024-09-15T22:41:50.670 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:41:50.672 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2024-09-15T22:41:50.672 INFO:teuthology.orchestra.run.smithi028.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T22:41:50.672 INFO:teuthology.orchestra.run.smithi028.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T22:41:50.672 INFO:teuthology.orchestra.run.smithi028.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T22:41:50.674 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2024-09-15T22:41:50.674 INFO:teuthology.orchestra.run.smithi028.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T22:41:50.674 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2024-09-15T22:41:50.674 INFO:teuthology.orchestra.run.smithi028.stdout: thermald 2024-09-15T22:41:50.716 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2024-09-15T22:41:50.717 INFO:teuthology.orchestra.run.smithi028.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T22:41:50.717 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T22:41:50.717 INFO:teuthology.orchestra.run.smithi028.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T22:41:50.718 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2024-09-15T22:41:50.719 INFO:teuthology.orchestra.run.smithi028.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T22:41:50.760 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T22:41:50.771 INFO:teuthology.orchestra.run.smithi028.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T22:41:50.771 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 113 MB of archives. 2024-09-15T22:41:50.771 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T22:41:50.771 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T22:41:51.222 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T22:41:51.336 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T22:41:51.597 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T22:41:51.597 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T22:41:51.597 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T22:41:51.721 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T22:41:51.742 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T22:41:52.119 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 113 MB in 2s (73.0 MB/s) 2024-09-15T22:41:52.162 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T22:41:52.162 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T22:41:52.162 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T22:41:52.291 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T22:41:52.297 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T22:41:52.313 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T22:41:52.719 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 113 MB in 2s (71.4 MB/s) 2024-09-15T22:41:52.884 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T22:41:54.240 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T22:41:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:54.311 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:41:54.912 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T22:41:54.916 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:54.990 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:41:56.330 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T22:41:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:56.429 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:41:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T22:41:56.854 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:56.892 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:41:57.124 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T22:41:57.146 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:57.229 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:41:57.703 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T22:41:57.724 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:41:57.761 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:03.519 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:03.621 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:03.988 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:04.116 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:04.403 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T22:42:04.414 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T22:42:04.453 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T22:42:04.878 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:04.980 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:05.296 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:05.424 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:05.753 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T22:42:05.775 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T22:42:05.819 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T22:42:10.229 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T22:42:10.266 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:42:10.312 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:11.666 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T22:42:11.704 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T22:42:11.732 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:12.827 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:12.941 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:13.266 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T22:42:13.396 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:13.497 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T22:42:13.634 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:14.438 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T22:42:14.635 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T22:42:14.935 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:14.935 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:14.935 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:14.935 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:14.959 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T22:42:15.081 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:15.112 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:15.207 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T22:42:15.318 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:16.496 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi028.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi028.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi028.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:16.653 INFO:teuthology.orchestra.run.smithi028.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:16.829 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:18.356 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T22:42:18.466 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T22:42:18.522 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:18.592 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:18.657 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T22:42:18.657 INFO:teuthology.orchestra.run.smithi131.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:19.973 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T22:42:20.099 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T22:42:20.217 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T22:42:20.277 INFO:teuthology.orchestra.run.smithi028.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T22:42:20.277 INFO:teuthology.orchestra.run.smithi028.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:33.266 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T22:42:33.267 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub' 2024-09-15T22:42:33.286 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:42:33.310 INFO:teuthology.orchestra.run.smithi131.stdout:Generating grub configuration file ... 2024-09-15T22:42:33.568 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:33.588 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:33.876 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:33.882 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:33.953 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:42:33.959 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:42:34.126 INFO:teuthology.orchestra.run.smithi131.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:42:34.126 INFO:teuthology.orchestra.run.smithi131.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:42:34.127 INFO:teuthology.orchestra.run.smithi131.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:42:34.172 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-09-15T22:42:34.641 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-09-15T22:42:34.660 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.121.121 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T22:42:34.661 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T22:42:34.662 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-09-15T22:42:34.662 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-09-15T22:42:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-09-15T22:42:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-09-15T22:42:34.662 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T22:42:34.662 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:42:34.662 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:42:34.662 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T22:42:34.662 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:42:34.663 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-09-15T22:42:34.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-15T22:42:34.921 INFO:teuthology.orchestra.run.smithi028.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T22:42:34.921 INFO:teuthology.orchestra.run.smithi028.stdout:Sourcing file `/etc/default/grub' 2024-09-15T22:42:34.953 INFO:teuthology.orchestra.run.smithi028.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:42:34.979 INFO:teuthology.orchestra.run.smithi028.stdout:Generating grub configuration file ... 2024-09-15T22:42:35.078 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:42:35.086 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:42:35.148 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:42:35.230 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:42:35.250 INFO:teuthology.orchestra.run.smithi028.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:35.264 INFO:teuthology.orchestra.run.smithi028.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:35.552 INFO:teuthology.orchestra.run.smithi028.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:35.558 INFO:teuthology.orchestra.run.smithi028.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:35.634 INFO:teuthology.orchestra.run.smithi028.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:42:35.640 INFO:teuthology.orchestra.run.smithi028.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:42:35.814 INFO:teuthology.orchestra.run.smithi028.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:42:35.814 INFO:teuthology.orchestra.run.smithi028.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:42:35.815 INFO:teuthology.orchestra.run.smithi028.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:42:35.849 INFO:teuthology.orchestra.run.smithi028.stdout:done 2024-09-15T22:42:36.356 DEBUG:teuthology.orchestra.run.smithi028:> dpkg -s linux-image-generic 2024-09-15T22:42:36.380 INFO:teuthology.orchestra.run.smithi028.stdout:Package: linux-image-generic 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Status: install ok installed 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Priority: optional 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Section: kernel 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Installed-Size: 21 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: amd64 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Source: linux-meta 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Version: 5.15.0.121.121 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T22:42:36.381 INFO:teuthology.orchestra.run.smithi028.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T22:42:36.382 INFO:teuthology.orchestra.run.smithi028.stdout:Recommends: thermald 2024-09-15T22:42:36.382 INFO:teuthology.orchestra.run.smithi028.stdout:Description: Generic Linux kernel image 2024-09-15T22:42:36.382 INFO:teuthology.orchestra.run.smithi028.stdout: This package will always depend on the latest generic kernel image 2024-09-15T22:42:36.382 INFO:teuthology.orchestra.run.smithi028.stdout: available. 2024-09-15T22:42:36.382 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T22:42:36.382 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:42:36.382 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:42:36.382 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T22:42:36.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:42:36.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get clean 2024-09-15T22:42:36.516 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:42:36.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T22:42:36.562 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2024-09-15T22:42:36.597 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:42:36.677 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:42:36.686 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:42:36.703 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:42:36.798 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:42:36.809 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-15T22:42:36.810 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-15T22:42:37.005 INFO:teuthology.orchestra.run.smithi131.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T22:42:37.005 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:42:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:42:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:42:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:42:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:42:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:42:37.006 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:42:37.049 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T22:42:37.052 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-09-15T22:42:37.067 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.121.121 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-09-15T22:42:37.068 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-09-15T22:42:37.069 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-15T22:42:37.121 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.gsW4Yv7uZo 2024-09-15T22:42:37.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gsW4Yv7uZo 2024-09-15T22:42:37.181 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.gsW4Yv7uZo 2024-09-15T22:42:37.304 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.gsW4Yv7uZo is 10KB 2024-09-15T22:42:37.317 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.gsW4Yv7uZo 2024-09-15T22:42:37.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T22:42:37.378 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:42:37.378 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T22:42:37.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T22:42:37.445 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T22:42:37.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo update-grub 2024-09-15T22:42:38.138 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:42:38.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T22:42:38.218 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:42:38.432 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-09-15T22:42:38.432 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-09-15T22:42:38.607 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:42:38.608 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:42:38.610 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-15T22:42:38.634 INFO:teuthology.orchestra.run.smithi028.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T22:42:38.634 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:42:38.634 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:42:38.634 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:42:38.635 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:42:38.635 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:42:38.635 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:42:38.635 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:42:38.682 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T22:42:38.684 DEBUG:teuthology.orchestra.run.smithi028:> dpkg -s linux-image-generic 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Package: linux-image-generic 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Status: install ok installed 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Priority: optional 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Section: kernel 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Installed-Size: 21 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: amd64 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Source: linux-meta 2024-09-15T22:42:38.700 INFO:teuthology.orchestra.run.smithi028.stdout:Version: 5.15.0.121.121 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout:Recommends: thermald 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout:Description: Generic Linux kernel image 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout: This package will always depend on the latest generic kernel image 2024-09-15T22:42:38.701 INFO:teuthology.orchestra.run.smithi028.stdout: available. 2024-09-15T22:42:38.701 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-15T22:42:38.747 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.B9BdwxXzlM 2024-09-15T22:42:38.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub/grub.cfg /tmp/tmp.B9BdwxXzlM 2024-09-15T22:42:38.789 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:38.795 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:38.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.B9BdwxXzlM 2024-09-15T22:42:38.924 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.B9BdwxXzlM is 10KB 2024-09-15T22:42:38.937 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.B9BdwxXzlM 2024-09-15T22:42:38.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T22:42:38.999 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:42:39.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T22:42:39.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T22:42:39.022 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:39.027 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:39.068 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T22:42:39.068 DEBUG:teuthology.orchestra.run.smithi028:> sudo update-grub 2024-09-15T22:42:39.070 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:42:39.075 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:42:39.197 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:42:39.197 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:42:39.197 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:42:39.219 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-15T22:42:39.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-09-15T22:42:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:42:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:42:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-09-15T22:42:40.437 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T22:42:40.444 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T22:42:40.672 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:42:40.678 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:42:40.719 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:42:40.725 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:42:40.870 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:42:40.870 INFO:teuthology.orchestra.run.smithi028.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:42:40.871 INFO:teuthology.orchestra.run.smithi028.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:42:40.882 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-09-15T22:42:40.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-09-15T22:43:09.255 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T22:43:09.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:43:09.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:43:10.892 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T22:43:10.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:43:10.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:43:27.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-09-15T22:43:29.213 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-15T22:43:36.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:43:36.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:43:38.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:43:38.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:44:36.749 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:44:38.219 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:44:48.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:44:48.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:44:49.062 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-15T22:44:49.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:44:49.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-15T22:44:49.613 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-15T22:44:49.664 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-121-generic 2024-09-15T22:44:49.664 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T22:44:49.664 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:44:49.664 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T22:44:50.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:44:50.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:44:50.504 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-15T22:44:50.665 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T22:44:50.666 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:44:51.001 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-09-15T22:44:51.033 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:51.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:44:51.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-15T22:44:51.061 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-15T22:44:51.106 INFO:teuthology.orchestra.run.smithi028.stdout:5.15.0-121-generic 2024-09-15T22:44:51.107 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T22:44:51.107 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:44:51.107 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T22:44:52.108 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T22:44:52.108 DEBUG:teuthology.orchestra.run.smithi028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:44:52.202 INFO:teuthology.orchestra.run.smithi028.stdout:ttyS1 2024-09-15T22:44:52.229 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:52.229 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:44:52.357 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:44:52.358 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:44:52.360 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:44:52.366 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:44:52.377 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:44:52.405 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:44:52.405 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:44:52.408 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:44:52.563 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:44:52.570 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:44:52.571 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:44:52.573 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:44:52.590 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:44:52.591 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:44:52.598 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:44:52.600 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:44:52.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:44:52.608 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:44:52.608 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:44:52.651 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:44:52.684 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:44:52.693 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:44:52.694 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:44:52.707 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:44:52.732 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:44:52.759 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:44:52.807 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:44:52.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:44:52.876 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:44:52.882 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:44:52.928 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:44:52.928 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:44:52.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-09-15T22:44:52.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-15T22:44:53.062 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:44:53.069 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:44:53.069 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:44:53.082 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:44:53.091 DEBUG:teuthology.task.selinux:Excluding smithi028: OS 'ubuntu' does not support SELinux 2024-09-15T22:44:53.091 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-09-15T22:44:53.091 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:44:53.091 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T22:44:53.091 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:44:53.091 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:44:53.100 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:44:53.113 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:44:53.113 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:52:30.705 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-09-15T22:52:30.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:52:30.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:52:30.814 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-15T22:52:30.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-15T22:52:30.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:52:30.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:52:30.974 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-15T22:52:31.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-15T22:52:31.049 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:52:31.059 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:52:31.059 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:52:31.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:52:31.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:52:31.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Command line: ntpd -gq 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: ---------------------------------------------------- 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: corporation. Support and training for ntp-4 are 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: available at https://www.nwtime.org/support 2024-09-15T22:52:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: ---------------------------------------------------- 2024-09-15T22:52:31.091 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: proto: precision = 0.058 usec (-24) 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: basedate set to 2022-02-04 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: gps base set to 2022-02-06 (week 2196) 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:52:31.092 INFO:teuthology.orchestra.run.smithi028.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:52:31.093 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T22:52:31.093 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T22:52:31.094 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T22:52:31.094 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen normally on 3 ens1f0 172.21.15.28:123 2024-09-15T22:52:31.094 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen normally on 4 lo [::1]:123 2024-09-15T22:52:31.094 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:ca3c%4]:123 2024-09-15T22:52:31.094 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:31 ntpd[18366]: Listening on routing socket on fd #22 for interface updates 2024-09-15T22:52:31.124 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T22:52:31.124 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Command line: ntpd -gq 2024-09-15T22:52:31.124 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: ---------------------------------------------------- 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: corporation. Support and training for ntp-4 are 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: available at https://www.nwtime.org/support 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: ---------------------------------------------------- 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: proto: precision = 0.045 usec (-24) 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: basedate set to 2022-02-04 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: gps base set to 2022-02-06 (week 2196) 2024-09-15T22:52:31.125 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:52:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:52:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:52:31.126 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen normally on 4 lo [::1]:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-09-15T22:52:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:31 ntpd[18496]: Listening on routing socket on fd #22 for interface updates 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:32.094 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:32.095 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:32 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:33 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:34 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:34.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:34 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:35.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:35.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:35.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:35.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:35.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:35.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:35 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:36.093 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:36 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:36.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:36 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:37.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:37.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:37 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:38.091 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:38.092 INFO:teuthology.orchestra.run.smithi028.stdout:15 Sep 22:52:38 ntpd[18366]: ntpd: time slew -0.001083 s 2024-09-15T22:52:38.092 INFO:teuthology.orchestra.run.smithi028.stdout:ntpd: time slew -0.001083s 2024-09-15T22:52:38.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T22:52:38.092 INFO:teuthology.orchestra.run.smithi028.stderr:15 Sep 22:52:38 ntpd[18366]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T22:52:38.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:38.124 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:38.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:38.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:38 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:38.142 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:39.125 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stdout:15 Sep 22:52:39 ntpd[18496]: ntpd: time slew +0.000172 s 2024-09-15T22:52:39.126 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew +0.000172s 2024-09-15T22:52:39.127 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T22:52:39.127 INFO:teuthology.orchestra.run.smithi131.stderr:15 Sep 22:52:39 ntpd[18496]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T22:52:39.181 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:52:39.182 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-09-15T22:52:39.182 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:39.182 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:39.182 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:39.182 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:52:39.182 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:52:39.190 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:52:39.190 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:52:39.190 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:52:39.191 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:52:39.196 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:52:39.196 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:52:39.197 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-key list | grep Ceph 2024-09-15T22:52:39.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-09-15T22:52:39.264 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T22:52:39.277 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T22:52:39.295 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T22:52:39.295 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T22:52:39.296 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T22:52:39.296 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T22:52:39.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:52:39.303 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T22:52:39.303 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T22:52:39.304 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T22:52:39.304 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T22:52:39.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:52:39.443 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T22:52:39.443 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:52:39.448 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T22:52:39.448 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:52:39.557 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:52:39.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T22:52:39.560 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:52:39.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T22:52:39.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2024-09-15T22:52:39.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-15T22:52:39.748 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:52:39.757 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:52:39.774 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:52:39.777 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:52:39.785 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:52:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T22:52:39.802 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:52:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:52:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T22:52:39.831 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T22:52:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T22:52:39.853 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T22:52:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T22:52:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T22:52:39.895 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T22:52:39.923 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T22:52:39.951 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:52:40.109 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 29.0 kB in 0s (82.8 kB/s) 2024-09-15T22:52:40.152 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 29.0 kB in 0s (80.4 kB/s) 2024-09-15T22:52:41.160 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:52:41.172 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:52:41.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:52:41.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:52:41.246 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:52:41.251 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:52:41.457 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-09-15T22:52:41.457 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-09-15T22:52:41.460 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-15T22:52:41.461 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-15T22:52:41.649 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:52:41.649 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2024-09-15T22:52:41.650 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi028.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi028.stdout: btrfs-tools 2024-09-15T22:52:41.655 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:52:41.656 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:52:41.657 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-15T22:52:41.657 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T22:52:41.657 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi131.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-09-15T22:52:41.766 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2024-09-15T22:52:41.767 INFO:teuthology.orchestra.run.smithi028.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T22:52:41.767 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T22:52:41.767 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T22:52:41.767 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T22:52:41.768 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:52:41.768 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T22:52:41.769 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T22:52:41.770 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T22:52:41.771 INFO:teuthology.orchestra.run.smithi028.stdout: socat unzip xmlstarlet zip 2024-09-15T22:52:41.773 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-15T22:52:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T22:52:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T22:52:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T22:52:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T22:52:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T22:52:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: socat unzip xmlstarlet zip 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 181 MB of archives. 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T22:52:41.847 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T22:52:41.856 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T22:52:41.897 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T22:52:41.912 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T22:52:41.912 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 181 MB of archives. 2024-09-15T22:52:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T22:52:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T22:52:41.914 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T22:52:41.919 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T22:52:41.922 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T22:52:41.933 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T22:52:41.957 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T22:52:41.983 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T22:52:41.987 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T22:52:41.998 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T22:52:42.001 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T22:52:42.002 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T22:52:42.010 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T22:52:42.012 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T22:52:42.014 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T22:52:42.015 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T22:52:42.015 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T22:52:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T22:52:42.023 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T22:52:42.024 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T22:52:42.038 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T22:52:42.038 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T22:52:42.039 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T22:52:42.039 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T22:52:42.055 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T22:52:42.056 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T22:52:42.058 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T22:52:42.072 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T22:52:42.073 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T22:52:42.073 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T22:52:42.074 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T22:52:42.074 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T22:52:42.074 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T22:52:42.075 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T22:52:42.085 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T22:52:42.089 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T22:52:42.090 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T22:52:42.094 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T22:52:42.106 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T22:52:42.108 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T22:52:42.108 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T22:52:42.109 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T22:52:42.110 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T22:52:42.111 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T22:52:42.113 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T22:52:42.120 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T22:52:42.124 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T22:52:42.126 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T22:52:42.126 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T22:52:42.133 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T22:52:42.141 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T22:52:42.143 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T22:52:42.193 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T22:52:42.193 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T22:52:42.195 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T22:52:42.195 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T22:52:42.196 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T22:52:42.213 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T22:52:42.214 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T22:52:42.215 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T22:52:42.216 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T22:52:42.228 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T22:52:42.230 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T22:52:42.230 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T22:52:42.231 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T22:52:42.231 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T22:52:42.231 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T22:52:42.232 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T22:52:42.234 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T22:52:42.235 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T22:52:42.238 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T22:52:42.246 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T22:52:42.246 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T22:52:42.249 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T22:52:42.253 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T22:52:42.258 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T22:52:42.259 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T22:52:42.260 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T22:52:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T22:52:42.262 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T22:52:42.264 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T22:52:42.264 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T22:52:42.266 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T22:52:42.268 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T22:52:42.270 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T22:52:42.270 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T22:52:42.271 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T22:52:42.280 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T22:52:42.280 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T22:52:42.283 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T22:52:42.284 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T22:52:42.284 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T22:52:42.285 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T22:52:42.291 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T22:52:42.299 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T22:52:42.299 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T22:52:42.299 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T22:52:42.300 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T22:52:42.303 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T22:52:42.304 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T22:52:42.310 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T22:52:42.316 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T22:52:42.317 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T22:52:42.318 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T22:52:42.333 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T22:52:42.372 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T22:52:42.385 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T22:52:42.434 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T22:52:42.495 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T22:52:42.497 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T22:52:42.507 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T22:52:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T22:52:42.527 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T22:52:42.537 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T22:52:42.608 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T22:52:42.616 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T22:52:42.643 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T22:52:42.652 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T22:52:42.653 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T22:52:42.671 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T22:52:42.676 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T22:52:42.680 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T22:52:42.682 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T22:52:42.690 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T22:52:42.765 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T22:52:42.769 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T22:52:42.773 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T22:52:42.774 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T22:52:42.775 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T22:52:42.778 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T22:52:42.778 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T22:52:42.779 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T22:52:42.780 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T22:52:42.853 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T22:52:42.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T22:52:42.863 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T22:52:42.868 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T22:52:42.869 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T22:52:42.870 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T22:52:42.871 INFO:teuthology.orchestra.run.smithi028.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T22:52:42.873 INFO:teuthology.orchestra.run.smithi028.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T22:52:42.874 INFO:teuthology.orchestra.run.smithi028.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T22:52:42.934 INFO:teuthology.orchestra.run.smithi028.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T22:52:42.957 INFO:teuthology.orchestra.run.smithi028.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T22:52:42.958 INFO:teuthology.orchestra.run.smithi028.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T22:52:42.959 INFO:teuthology.orchestra.run.smithi028.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T22:52:42.970 INFO:teuthology.orchestra.run.smithi028.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T22:52:42.970 INFO:teuthology.orchestra.run.smithi028.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T22:52:43.016 INFO:teuthology.orchestra.run.smithi028.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T22:52:43.017 INFO:teuthology.orchestra.run.smithi028.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T22:52:43.019 INFO:teuthology.orchestra.run.smithi028.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T22:52:43.023 INFO:teuthology.orchestra.run.smithi028.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T22:52:43.097 INFO:teuthology.orchestra.run.smithi028.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T22:52:43.099 INFO:teuthology.orchestra.run.smithi028.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T22:52:43.101 INFO:teuthology.orchestra.run.smithi028.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T22:52:43.108 INFO:teuthology.orchestra.run.smithi028.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T22:52:43.108 INFO:teuthology.orchestra.run.smithi028.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T22:52:43.178 INFO:teuthology.orchestra.run.smithi028.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T22:52:43.183 INFO:teuthology.orchestra.run.smithi028.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T22:52:43.404 INFO:teuthology.orchestra.run.smithi028.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T22:52:43.451 INFO:teuthology.orchestra.run.smithi028.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T22:52:43.452 INFO:teuthology.orchestra.run.smithi028.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T22:52:43.454 INFO:teuthology.orchestra.run.smithi028.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T22:52:43.455 INFO:teuthology.orchestra.run.smithi028.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T22:52:43.457 INFO:teuthology.orchestra.run.smithi028.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi028.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi028.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi028.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T22:52:43.532 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T22:52:43.534 INFO:teuthology.orchestra.run.smithi028.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T22:52:43.537 INFO:teuthology.orchestra.run.smithi028.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T22:52:43.539 INFO:teuthology.orchestra.run.smithi028.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T22:52:43.556 INFO:teuthology.orchestra.run.smithi028.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T22:52:43.556 INFO:teuthology.orchestra.run.smithi028.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T22:52:43.558 INFO:teuthology.orchestra.run.smithi028.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T22:52:43.613 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T22:52:43.616 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T22:52:43.616 INFO:teuthology.orchestra.run.smithi028.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T22:52:43.617 INFO:teuthology.orchestra.run.smithi028.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T22:52:43.617 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T22:52:43.618 INFO:teuthology.orchestra.run.smithi028.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T22:52:43.619 INFO:teuthology.orchestra.run.smithi028.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T22:52:43.620 INFO:teuthology.orchestra.run.smithi028.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T22:52:43.622 INFO:teuthology.orchestra.run.smithi028.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T22:52:43.629 INFO:teuthology.orchestra.run.smithi028.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T22:52:43.656 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T22:52:43.697 INFO:teuthology.orchestra.run.smithi028.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T22:52:43.701 INFO:teuthology.orchestra.run.smithi028.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T22:52:43.702 INFO:teuthology.orchestra.run.smithi028.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T22:52:43.754 INFO:teuthology.orchestra.run.smithi028.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T22:52:43.779 INFO:teuthology.orchestra.run.smithi028.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T22:52:43.786 INFO:teuthology.orchestra.run.smithi028.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T22:52:43.787 INFO:teuthology.orchestra.run.smithi028.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T22:52:43.789 INFO:teuthology.orchestra.run.smithi028.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T22:52:43.791 INFO:teuthology.orchestra.run.smithi028.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T22:52:43.803 INFO:teuthology.orchestra.run.smithi028.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T22:52:43.803 INFO:teuthology.orchestra.run.smithi028.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T22:52:43.859 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T22:52:43.860 INFO:teuthology.orchestra.run.smithi028.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T22:52:43.861 INFO:teuthology.orchestra.run.smithi028.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T22:52:43.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T22:52:43.941 INFO:teuthology.orchestra.run.smithi028.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T22:52:43.945 INFO:teuthology.orchestra.run.smithi028.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T22:52:43.947 INFO:teuthology.orchestra.run.smithi028.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T22:52:43.964 INFO:teuthology.orchestra.run.smithi028.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T22:52:43.965 INFO:teuthology.orchestra.run.smithi028.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T22:52:43.966 INFO:teuthology.orchestra.run.smithi028.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T22:52:43.971 INFO:teuthology.orchestra.run.smithi028.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T22:52:44.023 INFO:teuthology.orchestra.run.smithi028.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T22:52:44.600 INFO:teuthology.orchestra.run.smithi028.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T22:52:44.601 INFO:teuthology.orchestra.run.smithi028.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T22:52:44.618 INFO:teuthology.orchestra.run.smithi028.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T22:52:44.660 INFO:teuthology.orchestra.run.smithi028.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T22:52:44.670 INFO:teuthology.orchestra.run.smithi028.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T22:52:44.672 INFO:teuthology.orchestra.run.smithi028.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T22:52:44.699 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T22:52:44.699 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T22:52:44.717 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T22:52:44.717 INFO:teuthology.orchestra.run.smithi028.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T22:52:44.760 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T22:52:44.770 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T22:52:44.771 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T22:52:44.837 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T22:52:44.990 INFO:teuthology.orchestra.run.smithi028.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T22:52:44.991 INFO:teuthology.orchestra.run.smithi028.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T22:52:45.113 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T22:52:45.114 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T22:52:46.926 INFO:teuthology.orchestra.run.smithi028.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T22:52:46.929 INFO:teuthology.orchestra.run.smithi028.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T22:52:46.934 INFO:teuthology.orchestra.run.smithi028.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T22:52:46.935 INFO:teuthology.orchestra.run.smithi028.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T22:52:46.936 INFO:teuthology.orchestra.run.smithi028.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T22:52:46.937 INFO:teuthology.orchestra.run.smithi028.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T22:52:47.127 INFO:teuthology.orchestra.run.smithi028.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T22:52:47.174 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T22:52:47.177 INFO:teuthology.orchestra.run.smithi131.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T22:52:47.181 INFO:teuthology.orchestra.run.smithi131.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T22:52:47.182 INFO:teuthology.orchestra.run.smithi131.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T22:52:47.183 INFO:teuthology.orchestra.run.smithi131.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T22:52:47.185 INFO:teuthology.orchestra.run.smithi131.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T22:52:47.375 INFO:teuthology.orchestra.run.smithi131.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T22:52:47.797 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 181 MB in 5s (33.9 MB/s) 2024-09-15T22:52:47.942 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T22:52:47.994 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 181 MB in 6s (32.4 MB/s) 2024-09-15T22:52:48.036 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T22:52:48.042 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T22:52:48.082 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T22:52:48.131 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T22:52:48.220 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T22:52:48.225 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T22:52:48.271 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T22:52:48.343 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T22:52:48.359 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T22:52:48.393 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:52:48.574 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T22:52:48.601 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T22:52:48.640 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:52:48.704 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T22:52:48.730 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T22:52:48.779 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T22:52:49.002 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T22:52:49.029 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T22:52:49.060 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T22:52:49.140 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T22:52:49.167 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T22:52:49.248 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:52:49.372 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T22:52:49.398 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T22:52:49.472 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:52:49.585 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T22:52:49.612 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T22:52:49.652 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:52:49.767 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T22:52:49.794 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T22:52:49.834 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:52:49.988 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T22:52:50.015 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T22:52:50.054 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:52:50.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T22:52:50.189 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T22:52:50.229 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:52:50.424 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T22:52:50.451 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:50.491 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:50.633 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T22:52:50.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:50.707 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:50.927 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T22:52:50.954 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:50.994 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:51.161 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T22:52:51.187 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:51.228 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:51.313 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T22:52:51.329 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:51.372 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:51.531 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T22:52:51.557 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:52:51.597 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:52:51.683 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T22:52:51.710 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T22:52:51.741 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:52:51.943 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T22:52:51.969 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T22:52:52.009 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:52:52.036 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librados2. 2024-09-15T22:52:52.062 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:52.102 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:52.329 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-09-15T22:52:52.356 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:52.396 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:52.513 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librbd1. 2024-09-15T22:52:52.540 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:52.571 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:52.824 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-09-15T22:52:52.850 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:52.882 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.007 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T22:52:53.034 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:53.074 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.293 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T22:52:53.320 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:53.334 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rados. 2024-09-15T22:52:53.350 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:53.359 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.393 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.712 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T22:52:53.739 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:52:53.778 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.829 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-09-15T22:52:53.844 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:53.887 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:53.998 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T22:52:54.014 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:54.048 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T22:52:54.250 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:52:54.290 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:54.518 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T22:52:54.533 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:54.542 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T22:52:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:54.569 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:52:54.608 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:54.871 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T22:52:54.897 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:52:54.936 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T22:52:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:54.964 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T22:52:55.003 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T22:52:55.239 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T22:52:55.255 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:55.257 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T22:52:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T22:52:55.297 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T22:52:55.577 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T22:52:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:55.633 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T22:52:55.635 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:55.660 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T22:52:55.699 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:52:55.913 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T22:52:55.928 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T22:52:55.943 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T22:52:55.959 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T22:52:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:52:55.993 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:52:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T22:52:56.256 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T22:52:56.296 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T22:52:56.299 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:52:56.313 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T22:52:56.355 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:52:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T22:52:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T22:52:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:52:56.683 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua5.1. 2024-09-15T22:52:56.710 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:52:56.972 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-09-15T22:52:56.998 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T22:52:57.044 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-any. 2024-09-15T22:52:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:52:57.060 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T22:52:57.093 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T22:52:57.309 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package zip. 2024-09-15T22:52:57.320 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T22:52:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-09-15T22:52:57.371 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T22:52:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T22:52:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T22:52:57.678 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-09-15T22:52:57.704 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T22:52:57.707 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package unzip. 2024-09-15T22:52:57.734 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T22:52:57.745 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T22:52:57.774 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:52:58.040 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-09-15T22:52:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T22:52:58.106 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:52:58.178 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package luarocks. 2024-09-15T22:52:58.205 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T22:52:58.244 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:52:58.488 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-09-15T22:52:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T22:52:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:52:58.601 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librgw2. 2024-09-15T22:52:58.617 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:58.651 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-09-15T22:52:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:59.195 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T22:52:59.196 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:59.222 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:59.262 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:59.615 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T22:52:59.642 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T22:52:59.684 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:52:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T22:52:59.739 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:52:59.773 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:52:59.934 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T22:52:59.961 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:00.001 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:00.135 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T22:53:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T22:53:00.201 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:53:00.404 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-common. 2024-09-15T22:53:00.431 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:00.470 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:00.513 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T22:53:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:00.580 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:00.925 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-09-15T22:53:00.951 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:01.801 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-base. 2024-09-15T22:53:01.827 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:01.869 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:02.396 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T22:53:02.414 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-09-15T22:53:02.494 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T22:53:02.494 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:53:02.494 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:02.495 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:02.749 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T22:53:02.776 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T22:53:02.815 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:53:03.035 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T22:53:03.061 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T22:53:03.101 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:53:03.143 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T22:53:03.174 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T22:53:03.210 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:53:03.421 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T22:53:03.448 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T22:53:03.487 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T22:53:03.488 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:53:03.514 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T22:53:03.554 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:53:03.808 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T22:53:03.823 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T22:53:03.834 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T22:53:03.851 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T22:53:03.874 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:53:03.890 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:53:04.193 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T22:53:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T22:53:04.259 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T22:53:04.344 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T22:53:04.371 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T22:53:04.411 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:53:04.562 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-portend. 2024-09-15T22:53:04.589 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T22:53:04.681 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T22:53:04.707 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T22:53:04.747 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:53:05.033 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T22:53:05.060 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T22:53:05.090 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T22:53:05.100 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T22:53:05.117 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T22:53:05.148 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T22:53:05.403 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-09-15T22:53:05.430 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T22:53:05.459 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T22:53:05.469 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T22:53:05.486 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T22:53:05.525 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:53:05.723 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T22:53:05.749 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T22:53:05.789 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T22:53:05.871 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T22:53:05.898 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T22:53:05.937 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T22:53:06.092 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T22:53:06.119 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T22:53:06.159 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:53:06.215 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T22:53:06.242 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T22:53:06.273 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T22:53:06.496 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T22:53:06.523 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T22:53:06.543 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T22:53:06.563 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T22:53:06.570 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T22:53:06.609 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:53:06.874 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T22:53:06.901 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T22:53:06.912 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-mako. 2024-09-15T22:53:06.939 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T22:53:06.941 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T22:53:06.978 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:53:07.244 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T22:53:07.307 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T22:53:07.310 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:53:07.334 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T22:53:07.390 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:53:07.572 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-09-15T22:53:07.599 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:53:07.668 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T22:53:07.686 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T22:53:07.717 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:53:07.925 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T22:53:07.952 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T22:53:07.978 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webob. 2024-09-15T22:53:07.992 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:53:08.005 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T22:53:08.045 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:53:08.312 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T22:53:08.338 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T22:53:08.378 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:53:08.390 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T22:53:08.417 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T22:53:08.459 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:53:08.681 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T22:53:08.748 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:53:08.767 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T22:53:08.794 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T22:53:08.850 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:53:09.059 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T22:53:09.086 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T22:53:09.103 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-paste. 2024-09-15T22:53:09.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T22:53:09.128 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:53:09.161 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:53:09.456 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T22:53:09.472 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T22:53:09.514 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:53:09.580 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T22:53:09.606 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T22:53:09.646 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:53:09.809 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T22:53:09.836 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T22:53:09.875 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:53:09.958 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T22:53:10.024 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:53:10.178 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T22:53:10.205 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T22:53:10.244 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T22:53:10.294 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T22:53:10.309 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T22:53:10.344 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:53:10.556 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T22:53:10.583 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T22:53:10.630 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:53:10.639 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T22:53:10.665 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T22:53:10.705 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:53:10.985 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T22:53:11.009 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T22:53:11.012 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T22:53:11.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T22:53:11.051 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T22:53:11.075 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T22:53:11.321 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-idna. 2024-09-15T22:53:11.337 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T22:53:11.364 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T22:53:11.370 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:53:11.388 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T22:53:11.428 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:53:11.674 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T22:53:11.701 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T22:53:11.740 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:53:11.758 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T22:53:11.785 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T22:53:11.816 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T22:53:12.060 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests. 2024-09-15T22:53:12.087 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T22:53:12.111 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-09-15T22:53:12.138 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T22:53:12.143 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:53:12.178 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:53:12.479 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T22:53:12.506 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T22:53:12.523 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T22:53:12.546 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:53:12.549 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T22:53:12.589 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:53:12.834 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T22:53:12.860 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:12.899 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:12.909 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-09-15T22:53:12.936 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T22:53:12.976 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:53:13.262 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T22:53:13.287 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T22:53:13.289 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:13.314 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T22:53:13.328 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:13.354 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:53:13.632 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T22:53:13.639 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T22:53:13.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:13.666 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T22:53:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:13.705 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:53:14.054 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T22:53:14.081 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:14.121 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:14.415 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T22:53:14.445 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T22:53:14.482 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:53:14.785 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T22:53:14.809 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T22:53:14.811 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T22:53:14.837 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T22:53:14.853 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T22:53:14.875 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T22:53:15.154 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T22:53:15.181 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:15.211 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:15.615 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T22:53:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:16.072 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T22:53:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:16.318 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T22:53:16.345 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:16.384 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:16.542 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T22:53:16.568 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:16.608 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:17.188 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T22:53:17.215 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:17.254 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:17.404 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph. 2024-09-15T22:53:17.431 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:17.462 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:17.748 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T22:53:17.775 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:17.823 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:18.176 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T22:53:18.203 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:18.242 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:18.299 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-09-15T22:53:18.326 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:18.365 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:18.595 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephadm. 2024-09-15T22:53:18.620 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:18.653 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:18.685 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T22:53:18.711 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:18.751 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:18.923 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T22:53:18.950 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T22:53:18.989 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T22:53:19.130 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T22:53:19.156 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:19.196 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:19.292 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T22:53:19.308 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:53:19.342 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:19.516 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-09-15T22:53:19.539 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:19.707 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:20.027 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T22:53:20.054 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T22:53:20.093 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T22:53:20.397 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T22:53:20.424 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:53:20.443 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-babel. 2024-09-15T22:53:20.463 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:20.471 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:53:20.555 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:20.883 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T22:53:20.910 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T22:53:20.949 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:53:21.294 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T22:53:21.321 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:21.360 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:21.518 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-09-15T22:53:21.545 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:53:21.610 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:21.747 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T22:53:21.774 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T22:53:21.813 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T22:53:21.947 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T22:53:21.974 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T22:53:22.013 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:53:22.108 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-routes. 2024-09-15T22:53:22.135 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T22:53:22.174 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:53:22.367 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T22:53:22.394 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:22.433 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:22.502 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T22:53:22.529 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:22.568 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:22.770 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T22:53:22.797 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T22:53:22.836 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T22:53:23.139 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-09-15T22:53:23.166 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T22:53:23.206 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:53:23.534 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T22:53:23.561 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:23.601 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:23.734 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T22:53:23.750 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T22:53:23.792 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:53:24.262 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T22:53:24.290 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T22:53:24.329 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:53:24.674 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T22:53:24.701 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T22:53:24.826 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:53:24.856 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T22:53:24.872 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T22:53:24.906 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T22:53:25.140 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T22:53:25.178 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:53:25.393 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T22:53:25.421 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T22:53:25.459 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:53:25.839 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T22:53:25.854 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T22:53:25.866 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T22:53:25.882 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:25.921 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:25.990 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:53:26.310 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T22:53:26.338 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T22:53:26.368 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:53:26.882 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T22:53:26.910 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T22:53:26.949 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T22:53:27.037 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T22:53:27.064 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:27.103 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:27.260 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T22:53:27.288 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T22:53:27.327 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:53:27.655 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T22:53:27.683 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T22:53:27.738 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:53:28.040 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T22:53:28.049 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T22:53:28.067 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T22:53:28.077 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T22:53:28.106 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T22:53:28.116 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T22:53:28.359 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T22:53:28.375 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T22:53:28.409 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:53:28.428 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T22:53:28.456 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T22:53:28.494 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T22:53:28.722 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T22:53:28.749 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T22:53:28.788 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:53:28.814 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T22:53:28.842 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T22:53:28.881 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:53:29.100 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T22:53:29.126 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T22:53:29.166 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T22:53:29.203 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T22:53:29.242 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T22:53:29.495 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T22:53:29.512 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T22:53:29.522 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T22:53:29.540 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T22:53:29.561 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T22:53:29.578 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:53:30.065 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T22:53:30.092 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T22:53:30.131 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:53:30.226 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T22:53:30.253 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:30.312 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:30.426 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T22:53:30.454 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T22:53:30.493 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T22:53:30.637 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T22:53:30.665 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T22:53:30.703 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:53:30.804 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T22:53:30.831 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T22:53:30.871 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:53:31.165 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T22:53:31.193 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:53:31.223 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:53:31.484 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package jq. 2024-09-15T22:53:31.501 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:53:31.542 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T22:53:31.543 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T22:53:31.568 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:31.610 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:31.795 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package socat. 2024-09-15T22:53:31.812 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T22:53:31.853 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:53:31.938 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T22:53:31.966 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T22:53:32.005 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:53:32.165 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T22:53:32.193 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T22:53:32.231 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:53:32.308 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T22:53:32.335 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:53:32.375 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:53:32.561 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-test. 2024-09-15T22:53:32.577 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:32.619 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:32.636 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-09-15T22:53:32.654 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:53:32.694 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T22:53:32.947 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-09-15T22:53:32.963 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T22:53:33.005 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:53:33.300 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T22:53:33.316 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T22:53:33.350 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:53:33.671 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-09-15T22:53:33.687 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:33.729 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:34.890 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T22:53:34.918 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:34.956 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:35.353 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T22:53:35.380 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:35.474 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:35.814 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T22:53:35.842 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T22:53:35.871 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T22:53:36.099 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T22:53:36.116 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:36.118 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T22:53:36.145 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:36.157 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:36.184 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:36.427 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T22:53:36.444 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:36.485 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:36.572 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T22:53:36.600 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:36.639 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:36.738 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T22:53:36.754 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:36.796 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:36.975 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T22:53:37.003 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T22:53:37.041 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T22:53:37.107 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T22:53:37.135 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T22:53:37.173 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:53:37.294 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T22:53:37.310 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:37.344 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:37.453 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T22:53:37.470 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T22:53:37.511 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:53:37.591 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T22:53:37.618 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:53:37.657 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:37.882 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T22:53:37.910 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T22:53:37.910 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T22:53:37.937 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:37.948 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:53:37.976 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:38.279 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T22:53:38.306 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T22:53:38.345 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:53:38.371 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pkg-config. 2024-09-15T22:53:38.399 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T22:53:38.437 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:53:38.642 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T22:53:38.658 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T22:53:38.673 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T22:53:38.690 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T22:53:38.691 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:53:38.731 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:53:39.054 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T22:53:39.081 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T22:53:39.120 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:53:39.151 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T22:53:39.179 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T22:53:39.218 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T22:53:39.521 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T22:53:39.542 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-09-15T22:53:39.549 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T22:53:39.569 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T22:53:39.587 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T22:53:39.608 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:53:39.869 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T22:53:39.885 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T22:53:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T22:53:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T22:53:39.927 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:53:39.957 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:53:40.252 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T22:53:40.280 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T22:53:40.318 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T22:53:40.356 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T22:53:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T22:53:40.422 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T22:53:40.646 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-py. 2024-09-15T22:53:40.674 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T22:53:40.692 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T22:53:40.713 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T22:53:40.719 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T22:53:40.758 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T22:53:41.008 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T22:53:41.019 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T22:53:41.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T22:53:41.036 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T22:53:41.078 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:53:41.099 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:53:41.381 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T22:53:41.408 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T22:53:41.447 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T22:53:41.571 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T22:53:41.599 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T22:53:41.637 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:53:41.767 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-09-15T22:53:41.794 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T22:53:41.833 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T22:53:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-toml. 2024-09-15T22:53:41.931 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T22:53:41.964 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T22:53:42.170 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T22:53:42.197 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T22:53:42.236 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:53:42.251 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T22:53:42.279 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T22:53:42.317 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:53:42.637 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T22:53:42.654 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T22:53:42.687 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:53:42.699 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T22:53:42.727 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T22:53:42.782 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:53:42.923 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T22:53:42.940 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T22:53:42.981 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:53:43.110 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-09-15T22:53:43.137 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T22:53:43.168 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T22:53:43.471 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T22:53:43.499 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T22:53:43.537 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:53:43.677 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package radosgw. 2024-09-15T22:53:43.706 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:43.743 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:43.883 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T22:53:43.908 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T22:53:43.949 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:53:44.218 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T22:53:44.234 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T22:53:44.276 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:53:44.546 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T22:53:44.563 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:44.605 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:44.894 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T22:53:44.981 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-09-15T22:53:45.008 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:45.047 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:45.152 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:53:45.261 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:53:45.509 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T22:53:45.820 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T22:53:46.033 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T22:53:46.049 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:53:46.091 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:46.220 INFO:teuthology.orchestra.run.smithi028.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T22:53:46.280 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:46.387 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T22:53:46.638 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:53:46.764 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:53:46.813 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user cephadm....done 2024-09-15T22:53:46.978 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:53:47.036 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T22:53:47.254 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:53:47.366 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T22:53:47.497 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:53:47.623 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:53:47.816 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T22:53:47.882 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T22:53:47.883 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:48.142 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:53:48.301 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T22:53:48.407 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-09-15T22:53:48.564 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:53:48.620 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:53:48.832 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:53:48.980 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T22:53:49.083 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:53:49.209 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:53:49.223 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T22:53:49.474 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T22:53:49.476 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T22:53:49.736 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:53:49.742 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:53:49.837 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T22:53:50.002 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:53:50.130 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:53:50.278 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:53:50.482 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T22:53:50.529 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:53:50.725 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T22:53:50.876 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:50.976 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T22:53:51.189 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:53:51.243 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:53:51.307 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:53:51.433 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T22:53:51.470 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:53:51.713 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:53:51.884 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:53:51.972 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:53:52.010 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:53:52.240 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:52.270 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:53:52.558 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:53:52.634 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T22:53:52.659 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T22:53:52.684 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:53:52.723 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:53:52.811 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T22:53:52.849 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T22:53:53.077 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:53:53.203 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:53:53.208 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:53.334 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T22:53:53.454 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:53:53.619 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:53:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T22:53:53.852 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T22:53:53.887 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:53:53.916 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:53:54.042 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T22:53:54.180 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T22:53:54.289 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:53:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:53:54.569 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T22:53:54.828 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:53:54.982 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:53:55.112 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:53:55.242 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:53:55.368 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:53:55.447 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T22:53:55.519 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:53:55.548 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:53:55.812 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T22:53:56.188 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T22:53:56.439 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:53:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:53:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:53:56.816 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:53:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:53:57.044 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:53:57.108 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T22:53:57.345 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T22:53:57.418 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:53:57.738 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T22:53:57.778 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:53:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:53:58.020 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:53:58.138 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:58.366 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:53:58.440 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:53:58.709 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T22:53:58.790 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:53:59.026 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:53:59.353 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:53:59.595 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:53:59.721 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:53:59.955 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:54:00.014 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:54:00.190 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:00.324 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T22:54:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:54:00.592 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:54:00.718 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:54:00.852 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:54:01.162 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:54:01.397 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T22:54:01.563 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:54:01.648 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:01.765 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:54:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T22:54:02.083 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:54:02.175 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:54:02.301 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:54:02.343 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T22:54:02.427 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:54:02.611 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T22:54:02.712 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:54:02.887 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:54:02.954 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T22:54:03.138 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T22:54:03.197 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:03.323 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:54:03.422 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:54:03.548 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T22:54:03.624 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:54:03.841 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:54:03.892 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T22:54:03.967 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:54:04.143 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T22:54:04.260 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:54:04.377 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:54:04.578 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:54:04.628 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:54:04.871 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:54:04.955 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:54:04.997 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T22:54:05.081 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:54:05.170 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T22:54:05.290 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:54:05.408 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:54:05.416 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:54:05.534 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:54:05.700 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:54:05.927 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:54:06.001 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:54:06.203 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T22:54:06.252 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:54:06.329 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T22:54:06.353 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:54:06.463 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T22:54:06.588 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:06.714 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:54:06.797 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:54:06.932 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:54:07.163 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:54:07.333 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:54:07.458 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:54:07.601 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T22:54:07.735 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T22:54:07.752 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T22:54:07.948 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T22:54:08.003 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:54:08.112 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:54:08.199 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T22:54:08.430 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:54:08.467 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:54:08.727 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:54:08.731 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:54:09.032 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T22:54:09.112 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T22:54:09.243 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T22:54:09.413 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:54:09.486 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T22:54:09.754 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:54:09.757 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:54:09.883 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:10.009 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:10.022 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:54:10.136 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:54:10.399 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T22:54:10.413 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:10.539 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:10.665 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T22:54:10.692 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:54:10.942 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:54:11.068 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.154 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.194 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.279 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.405 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:54:11.407 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:54:11.407 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:54:11.769 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.887 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.893 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:11.988 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.002 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T22:54:12.106 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.232 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.254 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.358 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:54:12.371 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.497 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:12.721 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:54:12.721 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:54:13.223 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.350 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.475 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.601 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.687 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.727 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:54:13.838 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:13.955 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:14.056 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:14.182 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:14.308 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:14.860 INFO:teuthology.orchestra.run.smithi028.stdout:Adding group ceph....done 2024-09-15T22:54:14.964 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.224 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.228 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user ceph....done 2024-09-15T22:54:15.350 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.396 INFO:teuthology.orchestra.run.smithi028.stdout:Setting system user ceph properties....done 2024-09-15T22:54:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T22:54:15.476 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T22:54:15.602 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:15.884 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T22:54:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-09-15T22:54:16.376 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:16.488 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-09-15T22:54:16.596 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:54:16.596 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:54:16.656 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-09-15T22:54:16.672 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T22:54:16.807 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T22:54:17.044 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:17.128 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T22:54:17.162 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:17.594 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:17.628 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:54:17.628 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:54:17.803 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:54:17.803 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:54:18.064 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:18.296 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:18.405 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:18.423 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T22:54:18.847 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:54:18.847 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:54:18.882 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:19.117 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:54:19.117 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:54:19.307 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:19.593 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:19.654 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T22:54:19.820 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:54:19.820 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:54:20.133 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:20.269 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:20.358 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:54:20.359 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:54:20.553 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:54:20.554 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:54:20.835 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:21.054 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:54:21.054 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:54:21.154 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:21.255 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:21.398 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:21.512 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:21.604 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:54:21.604 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:54:21.797 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:54:21.797 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:54:22.165 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.296 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.325 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.406 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.451 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.565 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.611 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:22.777 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:54:22.777 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:54:22.972 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:54:23.073 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:54:23.225 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:54:23.283 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:23.542 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:23.668 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:23.820 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:54:24.164 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:54:24.289 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:54:24.293 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:54:24.451 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:54:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:54:24.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T22:54:24.977 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-09-15T22:54:25.192 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-09-15T22:54:25.193 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-09-15T22:54:25.412 INFO:teuthology.orchestra.run.smithi028.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T22:54:25.412 INFO:teuthology.orchestra.run.smithi028.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T22:54:25.412 INFO:teuthology.orchestra.run.smithi028.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T22:54:25.412 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:54:25.412 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:54:25.413 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:54:25.413 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:54:25.413 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:54:25.413 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:54:25.413 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:54:25.414 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2024-09-15T22:54:25.414 INFO:teuthology.orchestra.run.smithi028.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T22:54:25.414 INFO:teuthology.orchestra.run.smithi028.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T22:54:25.415 INFO:teuthology.orchestra.run.smithi028.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T22:54:25.415 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T22:54:25.415 INFO:teuthology.orchestra.run.smithi028.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:54:25.416 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2024-09-15T22:54:25.416 INFO:teuthology.orchestra.run.smithi028.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T22:54:25.417 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T22:54:25.417 INFO:teuthology.orchestra.run.smithi028.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T22:54:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2024-09-15T22:54:25.463 INFO:teuthology.orchestra.run.smithi028.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T22:54:25.463 INFO:teuthology.orchestra.run.smithi028.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T22:54:25.463 INFO:teuthology.orchestra.run.smithi028.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T22:54:25.464 INFO:teuthology.orchestra.run.smithi028.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T22:54:25.464 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T22:54:25.464 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T22:54:25.464 INFO:teuthology.orchestra.run.smithi028.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:54:25.465 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2024-09-15T22:54:25.466 INFO:teuthology.orchestra.run.smithi028.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T22:54:25.517 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:54:25.603 INFO:teuthology.orchestra.run.smithi028.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T22:54:25.603 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 55.8 MB of archives. 2024-09-15T22:54:25.604 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T22:54:25.604 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T22:54:25.735 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T22:54:25.743 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T22:54:25.784 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T22:54:25.784 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T22:54:25.785 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T22:54:25.797 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T22:54:25.798 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T22:54:25.800 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T22:54:25.802 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T22:54:25.802 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T22:54:25.803 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T22:54:25.804 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T22:54:25.819 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T22:54:25.819 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T22:54:25.820 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T22:54:26.148 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T22:54:26.150 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T22:54:26.150 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T22:54:26.153 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T22:54:26.153 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T22:54:26.158 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T22:54:26.160 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T22:54:26.167 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T22:54:26.168 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T22:54:26.178 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:54:26.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T22:54:26.190 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T22:54:26.191 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T22:54:26.201 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T22:54:26.221 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T22:54:26.224 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T22:54:26.224 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T22:54:26.225 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T22:54:26.225 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T22:54:26.235 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T22:54:26.237 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T22:54:26.240 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-15T22:54:26.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T22:54:26.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T22:54:26.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T22:54:26.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T22:54:26.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T22:54:26.439 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T22:54:26.451 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T22:54:26.451 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T22:54:26.451 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-15T22:54:26.451 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-15T22:54:26.650 INFO:teuthology.orchestra.run.smithi131.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T22:54:26.650 INFO:teuthology.orchestra.run.smithi131.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:54:26.651 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:54:26.652 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-15T22:54:26.652 INFO:teuthology.orchestra.run.smithi131.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T22:54:26.652 INFO:teuthology.orchestra.run.smithi131.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T22:54:26.653 INFO:teuthology.orchestra.run.smithi131.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T22:54:26.653 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T22:54:26.653 INFO:teuthology.orchestra.run.smithi131.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:54:26.654 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-15T22:54:26.654 INFO:teuthology.orchestra.run.smithi131.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T22:54:26.654 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T22:54:26.654 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T22:54:26.695 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-15T22:54:26.696 INFO:teuthology.orchestra.run.smithi131.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T22:54:26.696 INFO:teuthology.orchestra.run.smithi131.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T22:54:26.696 INFO:teuthology.orchestra.run.smithi131.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T22:54:26.696 INFO:teuthology.orchestra.run.smithi131.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T22:54:26.696 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T22:54:26.697 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T22:54:26.697 INFO:teuthology.orchestra.run.smithi131.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:54:26.698 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-09-15T22:54:26.698 INFO:teuthology.orchestra.run.smithi131.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T22:54:26.879 INFO:teuthology.orchestra.run.smithi131.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T22:54:26.879 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 55.8 MB of archives. 2024-09-15T22:54:26.880 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T22:54:26.880 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T22:54:26.880 INFO:teuthology.orchestra.run.smithi028.stdout:Preconfiguring packages ... 2024-09-15T22:54:27.038 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 55.8 MB in 1s (57.1 MB/s) 2024-09-15T22:54:27.307 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T22:54:27.313 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:27.498 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T22:54:27.514 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T22:54:27.526 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:27.638 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T22:54:27.639 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T22:54:27.640 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T22:54:27.668 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T22:54:27.670 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T22:54:27.674 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T22:54:27.676 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T22:54:27.677 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T22:54:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T22:54:27.741 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T22:54:27.741 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T22:54:27.742 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T22:54:27.822 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T22:54:28.205 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:28.563 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T22:54:28.567 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T22:54:28.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T22:54:28.574 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T22:54:28.575 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T22:54:28.584 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T22:54:28.587 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T22:54:28.601 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T22:54:28.601 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T22:54:28.661 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T22:54:28.686 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T22:54:28.709 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T22:54:28.777 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T22:54:28.782 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T22:54:28.783 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T22:54:28.784 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T22:54:28.785 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T22:54:28.813 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T22:54:28.816 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T22:54:29.113 INFO:teuthology.orchestra.run.smithi028.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T22:54:29.366 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T22:54:29.366 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T22:54:29.366 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T22:54:29.367 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T22:54:29.367 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T22:54:29.367 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T22:54:29.380 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package flex. 2024-09-15T22:54:29.392 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T22:54:29.392 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T22:54:29.486 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T22:54:29.506 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:29.528 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T22:54:29.803 INFO:teuthology.orchestra.run.smithi131.stdout:Preconfiguring packages ... 2024-09-15T22:54:29.932 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 55.8 MB in 3s (20.7 MB/s) 2024-09-15T22:54:30.029 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:54:30.201 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T22:54:30.212 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T22:54:30.218 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:30.347 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:30.605 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:30.989 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:31.131 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T22:54:31.137 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:31.275 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:31.660 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:31.798 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:31.951 INFO:teuthology.orchestra.run.smithi131.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T22:54:32.118 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:32.172 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package flex. 2024-09-15T22:54:32.262 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T22:54:32.268 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:32.304 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T22:54:32.709 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package bison. 2024-09-15T22:54:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T22:54:32.821 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:54:32.824 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T22:54:32.870 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:54:32.993 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T22:54:33.262 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T22:54:33.290 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T22:54:33.329 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:54:33.396 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:33.632 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package dump. 2024-09-15T22:54:33.649 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T22:54:33.681 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T22:54:33.935 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package indent. 2024-09-15T22:54:33.941 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T22:54:33.946 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:33.956 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:33.994 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:54:34.069 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:34.255 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T22:54:34.282 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T22:54:34.321 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:54:34.495 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:54:34.634 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T22:54:34.634 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:54:34.662 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T22:54:34.700 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:54:34.954 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:34.969 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T22:54:34.986 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T22:54:35.053 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:54:35.369 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package bison. 2024-09-15T22:54:35.398 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T22:54:35.427 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:35.465 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:35.474 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T22:54:35.480 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T22:54:35.530 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:54:35.701 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T22:54:35.717 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:35.759 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:35.905 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T22:54:35.933 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T22:54:35.972 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:54:35.978 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T22:54:35.995 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T22:54:36.037 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T22:54:36.340 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T22:54:36.368 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T22:54:36.400 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package dump. 2024-09-15T22:54:36.406 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:54:36.427 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T22:54:36.466 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T22:54:36.745 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package indent. 2024-09-15T22:54:36.773 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:36.812 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:54:37.073 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T22:54:37.089 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T22:54:37.131 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:54:37.469 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T22:54:37.497 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T22:54:37.536 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:54:37.788 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T22:54:37.805 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T22:54:37.847 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:54:38.184 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T22:54:38.211 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:38.259 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:38.511 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T22:54:38.535 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T22:54:38.539 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T22:54:38.563 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:54:38.578 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:38.602 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:38.829 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T22:54:38.854 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:54:38.889 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T22:54:38.896 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:38.917 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T22:54:38.956 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T22:54:39.232 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T22:54:39.261 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:54:39.268 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T22:54:39.295 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T22:54:39.299 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:39.334 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:54:39.644 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T22:54:39.672 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T22:54:39.710 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:54:40.030 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T22:54:40.058 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:54:40.096 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:54:40.400 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T22:54:40.428 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:40.466 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:40.802 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T22:54:40.831 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:40.869 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:54:41.012 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T22:54:41.040 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:54:41.071 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:41.155 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T22:54:41.173 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:41.213 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:54:41.332 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T22:54:41.359 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:54:41.398 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:41.457 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T22:54:41.486 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:54:41.516 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:41.751 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T22:54:41.779 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:54:41.818 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:42.070 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T22:54:42.098 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T22:54:42.136 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:54:42.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T22:54:42.190 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T22:54:42.229 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:54:42.481 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package modemmanager. 2024-09-15T22:54:42.509 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:54:42.516 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T22:54:42.543 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:54:42.556 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:42.582 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:54:42.927 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T22:54:42.955 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:42.994 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:43.188 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager. 2024-09-15T22:54:43.216 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:54:43.302 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:54:43.330 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T22:54:43.358 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:43.396 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:54:43.658 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T22:54:43.674 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:43.716 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:54:43.938 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ppp. 2024-09-15T22:54:43.966 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T22:54:44.003 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T22:54:44.028 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:54:44.070 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:44.243 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:54:44.568 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T22:54:44.596 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T22:54:44.598 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T22:54:44.626 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T22:54:44.635 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T22:54:44.665 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:54:44.863 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T22:54:44.879 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T22:54:44.913 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T22:54:44.969 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package modemmanager. 2024-09-15T22:54:44.997 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:54:45.044 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:45.224 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T22:54:45.252 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T22:54:45.290 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T22:54:45.619 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T22:54:45.642 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager. 2024-09-15T22:54:45.647 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:45.670 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:54:45.686 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:45.709 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:54:46.274 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T22:54:46.303 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T22:54:46.361 INFO:teuthology.orchestra.run.smithi028.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T22:54:46.367 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ppp. 2024-09-15T22:54:46.380 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-common (238) ... 2024-09-15T22:54:46.394 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T22:54:46.677 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:54:46.831 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T22:54:46.860 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:46.901 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:47.072 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T22:54:47.100 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T22:54:47.138 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T22:54:47.391 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T22:54:47.407 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T22:54:47.449 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T22:54:47.778 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T22:54:47.805 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T22:54:47.844 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T22:54:48.131 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:48.198 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:48.293 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql. 2024-09-15T22:54:48.310 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T22:54:48.351 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql (14+238) ... 2024-09-15T22:54:48.620 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T22:54:48.637 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T22:54:48.678 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T22:54:48.798 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T22:54:48.855 INFO:teuthology.orchestra.run.smithi131.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T22:54:48.923 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T22:54:48.951 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T22:54:48.989 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T22:54:49.001 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-common (238) ... 2024-09-15T22:54:49.334 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T22:54:49.362 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T22:54:49.400 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:54:49.495 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T22:54:49.523 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:54:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:49.669 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl. 2024-09-15T22:54:49.698 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T22:54:49.741 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T22:54:50.056 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T22:54:50.085 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T22:54:50.114 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:54:50.445 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T22:54:50.462 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T22:54:50.503 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T22:54:50.807 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql. 2024-09-15T22:54:50.822 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T22:54:50.835 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T22:54:50.840 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T22:54:50.873 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql (14+238) ... 2024-09-15T22:54:50.881 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:54:51.125 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T22:54:51.141 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T22:54:51.178 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T22:54:51.183 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T22:54:51.353 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T22:54:51.428 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T22:54:51.456 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T22:54:51.479 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:54:51.494 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T22:54:51.605 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:51.731 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:54:51.814 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T22:54:51.842 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T22:54:51.857 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:54:51.880 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:54:51.983 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:52.233 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl. 2024-09-15T22:54:52.250 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T22:54:52.296 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T22:54:52.504 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T22:54:52.597 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:54:52.620 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T22:54:52.648 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T22:54:52.686 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:54:53.008 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:54:53.008 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:54:53.032 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T22:54:53.061 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T22:54:53.100 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T22:54:53.427 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T22:54:53.456 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T22:54:53.491 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:53.494 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:54:53.626 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:54:53.744 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:53.757 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T22:54:53.861 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T22:54:53.970 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:54:53.977 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T22:54:54.105 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:54.230 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:54:54.357 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:54:54.559 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:54:54.686 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:54.820 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:54:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:54:55.089 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:54:55.104 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T22:54:55.199 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T22:54:55.264 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:55.506 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:54:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T22:54:55.616 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T22:54:55.644 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:54:55.716 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T22:54:55.843 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:54:55.934 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T22:54:56.019 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:54:56.029 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:54:56.029 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:54:56.153 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:54:56.355 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:54:56.481 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:56.523 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:54:56.606 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T22:54:56.648 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:54:56.774 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T22:54:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:54:56.892 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:54:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T22:54:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:54:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:54:57.331 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:54:57.331 INFO:teuthology.orchestra.run.smithi028.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T22:54:57.331 INFO:teuthology.orchestra.run.smithi028.stdout:which means they are currently configured by ifupdown: 2024-09-15T22:54:57.331 INFO:teuthology.orchestra.run.smithi028.stdout:- ens1f0 2024-09-15T22:54:57.331 INFO:teuthology.orchestra.run.smithi028.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T22:54:57.332 INFO:teuthology.orchestra.run.smithi028.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T22:54:57.332 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:54:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:54:57.453 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T22:54:57.779 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T22:54:58.101 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T22:54:58.135 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:54:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T22:54:58.355 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T22:54:58.422 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:54:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:54:58.569 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:58.674 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T22:54:58.799 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T22:54:58.925 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:54:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T22:54:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:54:59.088 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:54:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:54:59.222 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T22:54:59.348 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-common (238) ... 2024-09-15T22:54:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:54:59.514 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:54:59.899 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T22:55:00.261 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T22:55:00.272 INFO:teuthology.orchestra.run.smithi028.stdout:Adding user postgres to group ssl-cert 2024-09-15T22:55:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:55:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:00.504 INFO:teuthology.orchestra.run.smithi028.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T22:55:00.712 INFO:teuthology.orchestra.run.smithi028.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T22:55:00.712 INFO:teuthology.orchestra.run.smithi028.stdout:Removing obsolete dictionary files: 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:which means they are currently configured by ifupdown: 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:- enp3s0f1 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T22:55:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:00.956 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T22:55:01.264 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T22:55:01.269 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T22:55:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T22:55:01.649 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:55:01.981 INFO:teuthology.orchestra.run.smithi028.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T22:55:01.996 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:This user must also own the server process. 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:The default text search configuration will be set to "english". 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:02.037 INFO:teuthology.orchestra.run.smithi028.stdout:Data page checksums are disabled. 2024-09-15T22:55:02.038 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:02.038 INFO:teuthology.orchestra.run.smithi028.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T22:55:02.038 INFO:teuthology.orchestra.run.smithi028.stdout:creating subdirectories ... ok 2024-09-15T22:55:02.038 INFO:teuthology.orchestra.run.smithi028.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T22:55:02.053 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default max_connections ... 100 2024-09-15T22:55:02.071 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default shared_buffers ... 128MB 2024-09-15T22:55:02.081 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default time zone ... Etc/UTC 2024-09-15T22:55:02.082 INFO:teuthology.orchestra.run.smithi028.stdout:creating configuration files ... ok 2024-09-15T22:55:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:55:02.196 INFO:teuthology.orchestra.run.smithi028.stdout:running bootstrap script ... ok 2024-09-15T22:55:02.255 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:55:02.373 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T22:55:02.499 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-common (238) ... 2024-09-15T22:55:02.838 INFO:teuthology.orchestra.run.smithi028.stdout:performing post-bootstrap initialization ... ok 2024-09-15T22:55:03.385 INFO:teuthology.orchestra.run.smithi028.stdout:syncing data to disk ... ok 2024-09-15T22:55:03.429 INFO:teuthology.orchestra.run.smithi131.stdout:Adding user postgres to group ssl-cert 2024-09-15T22:55:03.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:03.655 INFO:teuthology.orchestra.run.smithi131.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T22:55:03.775 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T22:55:03.861 INFO:teuthology.orchestra.run.smithi131.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T22:55:03.861 INFO:teuthology.orchestra.run.smithi131.stdout:Removing obsolete dictionary files: 2024-09-15T22:55:04.406 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T22:55:04.784 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:55:05.122 INFO:teuthology.orchestra.run.smithi131.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T22:55:05.146 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T22:55:05.187 INFO:teuthology.orchestra.run.smithi131.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T22:55:05.187 INFO:teuthology.orchestra.run.smithi131.stdout:This user must also own the server process. 2024-09-15T22:55:05.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:The default text search configuration will be set to "english". 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:Data page checksums are disabled. 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:creating subdirectories ... ok 2024-09-15T22:55:05.188 INFO:teuthology.orchestra.run.smithi131.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T22:55:05.203 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default max_connections ... 100 2024-09-15T22:55:05.222 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default shared_buffers ... 128MB 2024-09-15T22:55:05.236 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default time zone ... Etc/UTC 2024-09-15T22:55:05.238 INFO:teuthology.orchestra.run.smithi131.stdout:creating configuration files ... ok 2024-09-15T22:55:05.355 INFO:teuthology.orchestra.run.smithi131.stdout:running bootstrap script ... ok 2024-09-15T22:55:05.935 INFO:teuthology.orchestra.run.smithi131.stdout:performing post-bootstrap initialization ... ok 2024-09-15T22:55:06.538 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:55:06.588 INFO:teuthology.orchestra.run.smithi131.stdout:syncing data to disk ... ok 2024-09-15T22:55:06.664 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T22:55:06.790 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql (14+238) ... 2024-09-15T22:55:06.916 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:55:06.991 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T22:55:07.042 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:55:07.308 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:55:07.309 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:55:07.844 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:55:07.937 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T22:55:08.247 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:55:08.399 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:55:09.749 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:55:09.875 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T22:55:10.001 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql (14+238) ... 2024-09-15T22:55:10.126 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T22:55:10.127 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:55:10.234 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:55:10.253 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:55:10.525 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:55:10.525 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:55:10.756 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:55:10.762 DEBUG:teuthology.parallel:result is None 2024-09-15T22:55:11.064 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:55:11.148 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T22:55:11.442 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:55:11.594 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:55:12.891 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T22:55:12.991 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:55:13.500 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:55:13.505 DEBUG:teuthology.parallel:result is None 2024-09-15T22:55:13.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:55:13.649 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-query -W -f '${Version}' ceph 2024-09-15T22:55:13.670 INFO:teuthology.orchestra.run.smithi028.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:55:13.670 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:55:13.671 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T22:55:13.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:55:13.810 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-09-15T22:55:13.830 INFO:teuthology.orchestra.run.smithi131.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:55:13.830 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:55:13.830 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T22:55:13.832 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:55:13.832 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:13.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:55:13.847 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:13.847 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:55:13.887 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:55:13.887 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:13.887 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:55:13.904 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:55:13.959 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:13.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:55:13.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:55:14.029 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:55:14.029 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:14.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:55:14.042 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:55:14.096 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:14.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:55:14.108 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:55:14.160 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:55:14.161 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:14.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:55:14.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:55:14.228 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:14.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:55:14.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:55:14.297 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T22:55:14.378 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T22:55:14.378 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2024-09-15T22:55:14.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-09-15T22:55:14.393 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T22:55:14.393 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:55:14.437 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:55:14.452 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T22:55:14.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:55:14.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:55:14.511 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T22:55:14.511 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T22:55:14.511 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T22:55:14.511 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:14.511 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:55:14.552 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:55:14.629 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:14.629 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:55:14.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:55:14.713 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T22:55:14.713 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T22:55:14.714 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906279', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFj1TO2UBpCqylpl9bKZDFAXQK+2Ul1f2ybpAjkbOJ2FL+OrPLpfeuwwcOjkmQqxXfRAqC+1vmcgv4EyifVG2M=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGyPkbbcBknz/wqJF3+O5K6Vvkx9EdkFu+wt4EwvB6l7AgM6JVBMQjEf950XOibQk3edrsRbIaphHeDwQZRsoY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T22:55:14.714 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:55:14.716 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:55:14.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:55:14.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:55:14.809 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:14.810 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:55:14.825 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:55:14.825 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-15 22:48:55.960635996 +0000 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-15 22:48:55.716638175 +0000 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-15 22:48:55.716638175 +0000 2024-09-15T22:55:14.873 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2024-09-15T22:55:14.874 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:55:14.927 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-15T22:55:14.927 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-15T22:55:14.927 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000318457 s, 1.6 MB/s 2024-09-15T22:55:14.928 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:55:14.978 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-15 22:48:56.456631566 +0000 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-15 22:48:56.200633852 +0000 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-15 22:48:56.200633852 +0000 2024-09-15T22:55:15.025 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2024-09-15T22:55:15.026 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:55:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-15T22:55:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-15T22:55:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000299861 s, 1.7 MB/s 2024-09-15T22:55:15.081 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:55:15.130 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-09-15T22:55:15.176 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-15 22:48:57.008626635 +0000 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-15 22:48:56.744628994 +0000 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-15 22:48:56.744628994 +0000 2024-09-15T22:55:15.177 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2024-09-15T22:55:15.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:55:15.231 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-15T22:55:15.231 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-15T22:55:15.231 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000306904 s, 1.7 MB/s 2024-09-15T22:55:15.232 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:55:15.282 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-09-15T22:55:15.328 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-15 22:48:57.480622419 +0000 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-15 22:48:57.232624634 +0000 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-15 22:48:57.232624634 +0000 2024-09-15T22:55:15.329 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2024-09-15T22:55:15.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:55:15.383 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-15T22:55:15.383 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-15T22:55:15.383 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000304128 s, 1.7 MB/s 2024-09-15T22:55:15.384 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:55:15.434 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:15.434 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:15.434 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:55:15.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:55:15.440 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-15T22:55:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:55:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.486 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 865 Links: 1 2024-09-15T22:55:15.486 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.486 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-15 22:48:55.874992882 +0000 2024-09-15T22:55:15.487 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-15 22:48:55.626995097 +0000 2024-09-15T22:55:15.487 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-15 22:48:55.626995097 +0000 2024-09-15T22:55:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-15T22:55:15.487 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:55:15.540 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-15T22:55:15.563 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-15T22:55:15.564 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000388489 s, 1.3 MB/s 2024-09-15T22:55:15.565 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:55:15.612 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-15 22:48:56.354988595 +0000 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-15 22:48:56.114990738 +0000 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-15 22:48:56.114990738 +0000 2024-09-15T22:55:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-15T22:55:15.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:55:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-15T22:55:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-15T22:55:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000314602 s, 1.6 MB/s 2024-09-15T22:55:15.713 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:55:15.763 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-15 22:48:56.610986307 +0000 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-15 22:48:56.606986344 +0000 2024-09-15T22:55:15.810 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-15 22:48:56.606986344 +0000 2024-09-15T22:55:15.811 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-15T22:55:15.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:55:15.864 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-15T22:55:15.864 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-15T22:55:15.864 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00033935 s, 1.5 MB/s 2024-09-15T22:55:15.865 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:55:15.919 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-15 22:48:57.394979305 +0000 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-15 22:48:57.134981627 +0000 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-15 22:48:57.134981627 +0000 2024-09-15T22:55:15.966 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-15T22:55:15.967 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:55:16.019 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-15T22:55:16.019 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-15T22:55:16.019 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000282089 s, 1.8 MB/s 2024-09-15T22:55:16.020 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:55:16.067 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:16.068 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:55:16.068 INFO:tasks.ceph:Generating config... 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] pid file = 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T22:55:16.069 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T22:55:16.069 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T22:55:16.070 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T22:55:16.071 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T22:55:16.071 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T22:55:16.071 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T22:55:16.071 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:55:16.071 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T22:55:16.072 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T22:55:16.072 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T22:55:16.072 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T22:55:16.072 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T22:55:16.072 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T22:55:16.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T22:55:16.108 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T22:55:16.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T22:55:16.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:55:16.264 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2024-09-15T22:55:16.265 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T22:55:16.265 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:16.266 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:55:16.313 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:16.399 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid f44574f1-d935-4d4e-b79e-1e1910665f93 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:fsid f44574f1-d935-4d4e-b79e-1e1910665f93 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2024-09-15T22:55:16.402981+0000 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-09-15T22:55:16.402981+0000 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 17 (quincy) 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-15T22:55:16.400 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2024-09-15T22:55:16.401 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T22:55:16.402 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:55:16.449 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f44574f1-d935-4d4e-b79e-1e1910665f93... 2024-09-15T22:55:16.450 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:55:16.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:55:16.521 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-09-15T22:55:16.521 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2024-09-15T22:55:16.521 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:55:16.521 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2024-09-15T22:55:16.521 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.522 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:55:16.523 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = f44574f1-d935-4d4e-b79e-1e1910665f93 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.524 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2024-09-15T22:55:16.525 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2024-09-15T22:55:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:55:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-15T22:55:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.529 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon down mkfs grace = 300 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon op complaint time = 120 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on pool no app = False 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2024-09-15T22:55:16.530 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: client mount timeout = 600 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = "" 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2024-09-15T22:55:16.531 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout:[mds] 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds = 20 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds balancer = 20 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug frag = True 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug scatterstat = True 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: mds op complaint time = 180 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: mds verify scatter = True 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2024-09-15T22:55:16.532 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-09-15T22:55:16.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-09-15T22:55:16.535 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-09-15T22:55:16.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = f44574f1-d935-4d4e-b79e-1e1910665f93 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:55:16.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.538 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-09-15T22:55:16.539 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-09-15T22:55:16.540 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-09-15T22:55:16.541 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-09-15T22:55:16.542 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on pool no app = False 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-15T22:55:16.543 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-15T22:55:16.544 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-09-15T22:55:16.545 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-09-15T22:55:16.545 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T22:55:16.545 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T22:55:16.628 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T22:55:16.628 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:16.628 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T22:55:16.633 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:16.633 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T22:55:16.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:55:16.680 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:16.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:55:16.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:55:16.745 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:16.745 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:16.792 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:55:16.792 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:16.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:55:16.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:55:16.816 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:16.816 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:16.862 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T22:55:16.863 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T22:55:16.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:55:16.907 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:55:16.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:55:16.954 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:55:16.962 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T22:55:16.962 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:55:17.005 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:55:17.008 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T22:55:17.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:55:17.152 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:55:17.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-15T22:55:17.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:55:17.213 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:55:17.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T22:55:17.270 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:55:17.352 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:55:17.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-15T22:55:17.408 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T22:55:17.408 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:55:17.447 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T22:55:17.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-15T22:55:17.536 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-15T22:55:17.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T22:55:17.583 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T22:55:17.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-15T22:55:17.670 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-15T22:55:17.681 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T22:55:17.681 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:55:17.681 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T22:55:17.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:17.697 INFO:tasks.ceph:role: osd.0 2024-09-15T22:55:17.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:55:17.697 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:17.752 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:17.753 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:17.753 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:17.776 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-15T22:55:17.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-15T22:55:17.777 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T22:55:17.840 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T22:55:17.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:17.893 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T22:55:17.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:17.948 INFO:tasks.ceph:role: osd.1 2024-09-15T22:55:17.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:55:17.948 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:55:18.003 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:18.004 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:18.027 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-15T22:55:18.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-15T22:55:18.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T22:55:18.088 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T22:55:18.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:18.142 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T22:55:18.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:18.196 INFO:tasks.ceph:role: osd.2 2024-09-15T22:55:18.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:55:18.196 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:55:18.253 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:18.253 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:18.253 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:18.253 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:18.254 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:18.277 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-15T22:55:18.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-15T22:55:18.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T22:55:18.337 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T22:55:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:18.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:18.390 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T22:55:18.444 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:18.444 INFO:tasks.ceph:role: osd.3 2024-09-15T22:55:18.445 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:55:18.445 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:55:18.500 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:18.501 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:18.524 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-15T22:55:18.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-15T22:55:18.527 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T22:55:18.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T22:55:18.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:18.634 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:18.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:18.743+0000 7f05529027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T22:55:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:18.747+0000 7f05529027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T22:55:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:18.747+0000 7f05529027c0 -1 bdev(0x55ec2ae0b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:18.747+0000 7f05529027c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T22:55:21.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T22:55:21.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:21.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:21.987+0000 7f752149f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T22:55:21.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:21.987+0000 7f752149f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T22:55:21.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:21.987+0000 7f752149f7c0 -1 bdev(0x55c7ec483800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:21.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:21.987+0000 7f752149f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T22:55:25.386 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T22:55:25.445 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:25.527+0000 7f5490a4f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T22:55:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:25.527+0000 7f5490a4f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T22:55:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:25.527+0000 7f5490a4f7c0 -1 bdev(0x55edab53b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:25.527+0000 7f5490a4f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T22:55:29.187 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T22:55:29.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:29.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:29.327+0000 7f2b6d4a17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T22:55:29.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:29.327+0000 7f2b6d4a17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T22:55:29.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:29.327+0000 7f2b6d4a17c0 -1 bdev(0x55f031f7b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:29.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:29.327+0000 7f2b6d4a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T22:55:32.696 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T22:55:32.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T22:55:32.769 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:32.769 INFO:tasks.ceph:role: osd.4 2024-09-15T22:55:32.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:55:32.770 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:32.833 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:33.284 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-15T22:55:33.285 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-15T22:55:33.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T22:55:33.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T22:55:33.410 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:33.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:33.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T22:55:33.465 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:33.465 INFO:tasks.ceph:role: osd.5 2024-09-15T22:55:33.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:55:33.465 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:33.530 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:33.531 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:33.531 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:33.531 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:34.015 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-15T22:55:34.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-15T22:55:34.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T22:55:34.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T22:55:34.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:34.192 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:34.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T22:55:34.246 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:34.246 INFO:tasks.ceph:role: osd.6 2024-09-15T22:55:34.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:55:34.246 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:34.309 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:34.310 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:34.788 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-15T22:55:34.790 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-15T22:55:34.791 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T22:55:34.935 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T22:55:34.946 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:34.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:34.947 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T22:55:35.001 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:55:35.001 INFO:tasks.ceph:role: osd.7 2024-09-15T22:55:35.002 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:55:35.002 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:55:35.066 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:55:35.490 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-15T22:55:35.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-15T22:55:35.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T22:55:35.580 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T22:55:35.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:55:35.591 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:55:35.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:35.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:35.705+0000 7fb0b4fcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T22:55:35.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:35.705+0000 7fb0b4fcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T22:55:35.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:35.705+0000 7fb0b4fcf7c0 -1 bdev(0x5617309a9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:35.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:35.709+0000 7fb0b4fcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T22:55:38.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T22:55:38.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:38.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:38.953+0000 7f4400f3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T22:55:38.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:38.957+0000 7f4400f3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T22:55:38.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:38.957+0000 7f4400f3c7c0 -1 bdev(0x559e7b953800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:38.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:38.957+0000 7f4400f3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T22:55:42.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T22:55:42.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:42.229+0000 7f091b3ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T22:55:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:42.233+0000 7f091b3ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T22:55:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:42.233+0000 7f091b3ea7c0 -1 bdev(0x55e043217800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:42.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:42.233+0000 7f091b3ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T22:55:44.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:55:44.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:55:45.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T22:55:45.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:45.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:45.445+0000 7f37de8db7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T22:55:45.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:45.445+0000 7f37de8db7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T22:55:45.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:45.445+0000 7f37de8db7c0 -1 bdev(0x55f942b53800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T22:55:45.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:45.445+0000 7f37de8db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T22:55:48.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T22:55:48.898 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T22:55:48.898 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:48.898 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T22:55:48.912 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:48.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T22:55:48.967 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:48.967 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-15T22:55:49.024 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T22:55:49.079 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T22:55:49.135 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T22:55:49.191 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T22:55:49.247 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T22:55:49.261 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T22:55:49.316 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.316 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-15T22:55:49.368 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T22:55:49.420 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T22:55:49.472 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T22:55:49.524 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T22:55:49.577 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.577 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T22:55:49.583 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:49.583 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-15T22:55:49.632 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.632 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T22:55:49.637 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:49.637 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-15T22:55:49.686 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T22:55:49.686 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:55:49.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:55:49.731 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2024-09-15T22:55:49.731 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDUZedm/h5PNhAAHa2ueT90xSXDFYPKgX/z1A== 2024-09-15T22:55:49.731 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedm3VmBABAAvArGEMRHBqR4+onQhfvLWw== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedm+UhHCRAADCzYYFA/byDLhc0gyhKtjg== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDWZedm0mjGLBAAgudL/qgd3Apx7aNMkuv1ew== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDZZedmJC4YOxAAYFJqOAKxORBJu/etCT0cug== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDdZedm0NGqHxAAuo+sT8jTpNMk0Nn6e0asOw== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDhZedmjcjJExAApX0Gy+AFj4agMJeTYEjlqw== 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2024-09-15T22:55:49.732 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDUZedmLRUPORAAaKVTRYkUjwpfJIdrQ3iXPw== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmNvriDBAAOw+cBCCkpdgYizzytoLBqw== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedm/YYtFRAACfJwJbZMto9fuV3Cwwy17g== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDnZedmOydVKhAAefigK6MQckJuqoT6uvgzng== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDqZedmum88ORAAmvNaB0qjP0GC7HsW6SSYlw== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDuZedm8moZDhAANQOtbsX8obocRfT7T/7c8g== 2024-09-15T22:55:49.733 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDxZedmYMjiGhAA+N2wn1W2iROVzEVPtN9EHw== 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout:[client.2] 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmMXYkIBAA2gP9aTm1jv+VT40Ph7wqTw== 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmEgz6IhAABJCMdbBOU5/r3vd3wgkbiw== 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout:[client.3] 2024-09-15T22:55:49.734 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmRKojKBAAY3fDsqBeGseUKhWG5OymrA== 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDUZedm/h5PNhAAHa2ueT90xSXDFYPKgX/z1A== 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedm3VmBABAAvArGEMRHBqR4+onQhfvLWw== 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedm+UhHCRAADCzYYFA/byDLhc0gyhKtjg== 2024-09-15T22:55:49.740 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDWZedm0mjGLBAAgudL/qgd3Apx7aNMkuv1ew== 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDZZedmJC4YOxAAYFJqOAKxORBJu/etCT0cug== 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDdZedm0NGqHxAAuo+sT8jTpNMk0Nn6e0asOw== 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDhZedmjcjJExAApX0Gy+AFj4agMJeTYEjlqw== 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDUZedmLRUPORAAaKVTRYkUjwpfJIdrQ3iXPw== 2024-09-15T22:55:49.741 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedmNvriDBAAOw+cBCCkpdgYizzytoLBqw== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedm/YYtFRAACfJwJbZMto9fuV3Cwwy17g== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDnZedmOydVKhAAefigK6MQckJuqoT6uvgzng== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDqZedmum88ORAAmvNaB0qjP0GC7HsW6SSYlw== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDuZedm8moZDhAANQOtbsX8obocRfT7T/7c8g== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDxZedmYMjiGhAA+N2wn1W2iROVzEVPtN9EHw== 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-09-15T22:55:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedmMXYkIBAA2gP9aTm1jv+VT40Ph7wqTw== 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedmEgz6IhAABJCMdbBOU5/r3vd3wgkbiw== 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2024-09-15T22:55:49.743 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDVZedmRKojKBAAY3fDsqBeGseUKhWG5OymrA== 2024-09-15T22:55:49.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:55:49.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:55:49.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:49.865 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:49.910 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:49.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:49.997 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.343 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:55:50.346 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:55:50.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:50.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:50.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:50.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:55:50.608 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.697 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.742 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.830 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:55:50.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:50.956 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.053 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.055 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.139 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:55:51.229 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T22:55:51.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T22:55:51.242 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:55:51.335 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T22:55:51.345 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T22:55:51.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:55:51.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T22:55:51.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T22:55:51.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:55:51.609 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T22:55:51.620 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:51.623 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:55:51.669 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T22:55:51.669 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T22:55:51.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T22:55:51.671 INFO:tasks.ceph.mon.a:Started 2024-09-15T22:55:51.672 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T22:55:51.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T22:55:51.714 INFO:tasks.ceph.mon.b:Started 2024-09-15T22:55:51.714 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T22:55:51.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T22:55:51.716 INFO:tasks.ceph.mon.c:Started 2024-09-15T22:55:51.716 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T22:55:51.717 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T22:55:51.717 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T22:55:51.719 INFO:tasks.ceph.mgr.y:Started 2024-09-15T22:55:51.719 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T22:55:51.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T22:55:51.721 INFO:tasks.ceph.mgr.x:Started 2024-09-15T22:55:51.721 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T22:55:51.722 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T22:55:51.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 Processor -- start 2024-09-15T22:55:51.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 -- start start 2024-09-15T22:55:51.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce00b68b0 con 0x7f8ce00b6470 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce0160ce0 con 0x7f8ce00b71b0 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce6ed3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce00b53d0 con 0x7f8ce015c090 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8cdffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8ce00b6470 0x7f8ce00b6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33954/0 (socket says 172.21.15.28:33954) 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8cdffff640 1 -- 172.21.15.28:0/878794256 learned_addr learned my addr 172.21.15.28:0/878794256 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:51.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:51.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:55:51.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:51.843+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:52.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:52.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:55:52.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.047+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T22:55:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:55:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:52.451+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:53.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:55:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:53.255+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:55:54.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 msgr2=0x7f8ce00ce920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:55:54.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce015c090 0x7f8ce00ce920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 msgr2=0x7f8ce01607a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.131:3300/0 conn(0x7f8ce00b71b0 0x7f8ce01607a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 -- 172.21.15.28:0/878794256 >> v1:172.21.15.28:6789/0 conn(0x7f8ce00b6470 legacy=0x7f8ce00b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 -- 172.21.15.28:0/878794256 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce00b56b0 con 0x7f8ccc006180 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8cde7fc640 1 -- 172.21.15.28:0/878794256 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce00b53d0 con 0x7f8ccc0036f0 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:54.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:54.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:54.842+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:55:55.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.046+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:55.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.046+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:55.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.046+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:55.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.046+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:55.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.046+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:55:55.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.450+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:55.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.450+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:55.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.450+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:55.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.450+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:55.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:55.450+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:55:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:56.254+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:56.254+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:55:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:56.254+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:55:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:56.254+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:55:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:56.254+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:55:57.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.114+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95977207 0 0) 0x7f8ce00b56b0 con 0x7f8ccc006180 2024-09-15T22:55:57.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.114+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cc8003530 con 0x7f8ccc006180 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3740100423 0 0) 0x7f8cc8003530 con 0x7f8ccc006180 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 msgr2=0x7f8ccc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 --2- 172.21.15.28:0/878794256 >> v2:172.21.15.28:3300/0 conn(0x7f8ccc0036f0 0x7f8ccc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc00af80 con 0x7f8ccc006180 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f8cd4001700 con 0x7f8ccc006180 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 >> v1:172.21.15.131:6789/0 conn(0x7f8ccc006180 legacy=0x7f8ccc008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8ce5470640 1 -- 172.21.15.28:0/878794256 reap_dead start 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 0x7f8cc8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8004810 0x7f8cc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 0x7f8cc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce00b53d0 con 0x7f8cc8003a10 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc800c290 con 0x7f8cc80053d0 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc800c490 con 0x7f8cc8004810 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8cdffff640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8004810 0x7f8cc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 0x7f8cc8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.118+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 0x7f8cc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8004810 msgr2=0x7f8cc8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8004810 0x7f8cc8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 msgr2=0x7f8cc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 0x7f8cc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce4c6f640 1 -- 172.21.15.28:0/878794256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc8003530 con 0x7f8cc8003a10 2024-09-15T22:55:57.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.122+0000 7f8ce5470640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 0x7f8cc800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:57.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.126+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 0x7f8cc8003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0019b20 tx=0x7f8cd001dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a4340db21a9f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.126+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000f040 con 0x7f8cc8003a10 2024-09-15T22:55:57.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.126+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd00a6ca0 con 0x7f8cc8003a10 2024-09-15T22:55:57.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.126+0000 7f8cdf7fe640 1 -- 172.21.15.28:0/878794256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0004260 con 0x7f8cc8003a10 2024-09-15T22:55:57.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 msgr2=0x7f8cc8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 0x7f8cc8003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0019b20 tx=0x7f8cd001dd80 comp rx=0 tx=0).stop 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/878794256 shutdown_connections 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc80053d0 0x7f8cc800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8004810 0x7f8cc8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/878794256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc8003a10 0x7f8cc8003e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/878794256 >> 172.21.15.28:0/878794256 conn(0x7f8ce006f470 msgr2=0x7f8ce006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/878794256 shutdown_connections 2024-09-15T22:55:57.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/878794256 wait complete. 2024-09-15T22:55:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 Processor -- start 2024-09-15T22:55:57.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- start start 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8003a10 0x7f8ce01f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 0x7f8ce0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 0x7f8ce01532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce00b5f50 con 0x7f8cc80053d0 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce00b5c70 con 0x7f8cc8004810 2024-09-15T22:55:57.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce6ed3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce015c470 con 0x7f8cc8003a10 2024-09-15T22:55:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 0x7f8ce0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce5470640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 0x7f8ce01532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 0x7f8ce0152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:39506/0 (socket says 172.21.15.28:39506) 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8cdffff640 1 -- 172.21.15.28:0/889901289 learned_addr learned my addr 172.21.15.28:0/889901289 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.130+0000 7f8ce4c6f640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8003a10 0x7f8ce01f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 -- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8003a10 msgr2=0x7f8ce01f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8003a10 0x7f8ce01f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 -- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 msgr2=0x7f8ce0152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 0x7f8ce0152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 -- 172.21.15.28:0/889901289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce0151bd0 con 0x7f8cc80053d0 2024-09-15T22:55:57.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce5470640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 0x7f8ce01532c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009de0 tx=0x7f8cd8015330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd801b070 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd8020460 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8020830 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce0151eb0 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce015ce60 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cd80209d0 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8cd8017c10 con 0x7f8cc80053d0 2024-09-15T22:55:57.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.134+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce00ce920 con 0x7f8cc80053d0 2024-09-15T22:55:57.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.138+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8cd8010050 con 0x7f8cc80053d0 2024-09-15T22:55:57.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.202+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8ce00d2900 con 0x7f8cc80053d0 2024-09-15T22:55:57.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8cdd7fa640 1 -- 172.21.15.28:0/889901289 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8cd8003e60 con 0x7f8cc80053d0 2024-09-15T22:55:57.204 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 msgr2=0x7f8ce01532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 0x7f8ce01532c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009de0 tx=0x7f8cd8015330 comp rx=0 tx=0).stop 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 shutdown_connections 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc80053d0 0x7f8ce01532c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8004810 0x7f8ce0152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 --2- 172.21.15.28:0/889901289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc8003a10 0x7f8ce01f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 >> 172.21.15.28:0/889901289 conn(0x7f8ce006f470 msgr2=0x7f8ce00b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:57.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 shutdown_connections 2024-09-15T22:55:57.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:57.206+0000 7f8ce6ed3640 1 -- 172.21.15.28:0/889901289 wait complete. 2024-09-15T22:55:57.223 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T22:55:57.223 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T22:55:57.224 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:57.224 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T22:55:57.235 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:57.235 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T22:55:57.286 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:57.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T22:55:57.324 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:57.326+0000 7f5f396cc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:55:57.336 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:55:57.337 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T22:55:57.391 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:57.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T22:55:57.405 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:57.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T22:55:57.466 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:57.466 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T22:55:57.525 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:55:57.525 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T22:55:57.561 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:57.557+0000 7fe38f939180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:55:57.572 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f9b9c5b9-4f0d-4cef-b59e-b815584470b7 0 2024-09-15T22:55:57.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.733+0000 7f6d3e7ce640 1 Processor -- start 2024-09-15T22:55:57.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.733+0000 7f6d3e7ce640 1 -- start start 2024-09-15T22:55:57.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3e7ce640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6d380cd5e0 0x7f6d3806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3e7ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 0x7f6d38072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3e7ce640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d380b4f60 con 0x7f6d3815b430 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3e7ce640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3806ff10 con 0x7f6d3806fae0 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3e7ce640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6d380b5240 con 0x7f6d380cd5e0 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6d380cd5e0 0x7f6d3806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d37fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6d3815b430 0x7f6d380b42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50246/0 (socket says 172.21.15.131:50246) 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d37fff640 1 -- 172.21.15.131:0/102115826 learned_addr learned my addr 172.21.15.131:0/102115826 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 -- 172.21.15.131:0/102115826 >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 msgr2=0x7f6d38072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3cd6b640 1 --2- 172.21.15.131:0/102115826 >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 0x7f6d38072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 --2- 172.21.15.131:0/102115826 >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 0x7f6d38072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 -- 172.21.15.131:0/102115826 >> v1:172.21.15.131:6789/0 conn(0x7f6d3815b430 legacy=0x7f6d380b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d36ffd640 1 -- 172.21.15.131:0/102115826 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386455476 0 0) 0x7f6d380b4f60 con 0x7f6d3815b430 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 -- 172.21.15.131:0/102115826 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d380b5520 con 0x7f6d380cd5e0 2024-09-15T22:55:57.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d3cd6b640 1 --2- 172.21.15.131:0/102115826 >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 0x7f6d38072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:57.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d377fe640 1 --2- 172.21.15.131:0/102115826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d380cd5e0 0x7f6d3806f5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d380b7490 tx=0x7f6d2c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3865df81eed2deba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d36ffd640 1 -- 172.21.15.131:0/102115826 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0b0070 con 0x7f6d380cd5e0 2024-09-15T22:55:57.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d36ffd640 1 -- 172.21.15.131:0/102115826 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0ab600 con 0x7f6d380cd5e0 2024-09-15T22:55:57.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.737+0000 7f6d36ffd640 1 -- 172.21.15.131:0/102115826 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0ab9d0 con 0x7f6d380cd5e0 2024-09-15T22:55:57.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/102115826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d380cd5e0 msgr2=0x7f6d3806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/102115826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d380cd5e0 0x7f6d3806f5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d380b7490 tx=0x7f6d2c01c3f0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/102115826 shutdown_connections 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/102115826 >> v2:172.21.15.28:3300/0 conn(0x7f6d3806fae0 0x7f6d38072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/102115826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d380cd5e0 0x7f6d3806f5a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/102115826 >> 172.21.15.131:0/102115826 conn(0x7f6d380b2fb0 msgr2=0x7f6d380b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/102115826 shutdown_connections 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/102115826 wait complete. 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 Processor -- start 2024-09-15T22:55:57.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- start start 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 0x7f6d38150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d380cd5e0 0x7f6d3806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38074020 con 0x7f6d3806fae0 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38073ea0 con 0x7f6d3815b430 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380741a0 con 0x7f6d380cd5e0 2024-09-15T22:55:57.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34568/0 (socket says 172.21.15.131:34568) 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 -- 172.21.15.131:0/3925418312 learned_addr learned my addr 172.21.15.131:0/3925418312 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d377fe640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d380cd5e0 0x7f6d3806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d37fff640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 0x7f6d38150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 -- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d380cd5e0 msgr2=0x7f6d3806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d380cd5e0 0x7f6d3806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 -- 172.21.15.131:0/3925418312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 msgr2=0x7f6d38150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 0x7f6d38150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 -- 172.21.15.131:0/3925418312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3815a0a0 con 0x7f6d3815b430 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d37fff640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 0x7f6d38150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3cd6b640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000cca0 tx=0x7f6d3000a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000f680 con 0x7f6d3815b430 2024-09-15T22:55:57.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3000f840 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d38151310 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000fc30 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3815a600 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d30018400 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6d30021930 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.741+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d38072f00 con 0x7f6d3815b430 2024-09-15T22:55:57.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.745+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6d3815a0a0 con 0x7f6d3815b430 2024-09-15T22:55:57.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.833+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9b9c5b9-4f0d-4cef-b59e-b815584470b7", "id": 0} v 0) -- 0x7f6d380b4450 con 0x7f6d3815b430 2024-09-15T22:55:57.834 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:57.834+0000 7f5f396cc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:55:57.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d34ff9640 1 -- 172.21.15.131:0/3925418312 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9b9c5b9-4f0d-4cef-b59e-b815584470b7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6d30014030 con 0x7f6d3815b430 2024-09-15T22:55:57.838 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-09-15T22:55:57.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 msgr2=0x7f6d381f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000cca0 tx=0x7f6d3000a650 comp rx=0 tx=0).stop 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 shutdown_connections 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d3815b430 0x7f6d381f6af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d380cd5e0 0x7f6d3806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 --2- 172.21.15.131:0/3925418312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d3806fae0 0x7f6d38150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 >> 172.21.15.131:0/3925418312 conn(0x7f6d380b2fb0 msgr2=0x7f6d3815bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 shutdown_connections 2024-09-15T22:55:57.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.837+0000 7f6d3e7ce640 1 -- 172.21.15.131:0/3925418312 wait complete. 2024-09-15T22:55:57.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 717b2c63-937b-410d-b5be-0f7b5cd31216 1 2024-09-15T22:55:57.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.969+0000 7f0a2ef38640 1 Processor -- start 2024-09-15T22:55:57.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.969+0000 7f0a2ef38640 1 -- start start 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ef38640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a2815b430 0x7f0a280b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ef38640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a280b4f60 con 0x7f0a2806fcb0 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ef38640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a280b5240 con 0x7f0a280cd5e0 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ef38640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280b47f0 con 0x7f0a2815b430 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a2815b430 0x7f0a280b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a2815b430 0x7f0a280b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34574/0 (socket says 172.21.15.131:34574) 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a27fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0a280cd5e0 0x7f0a2806f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50258/0 (socket says 172.21.15.131:50258) 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2294694711 learned_addr learned my addr 172.21.15.131:0/2294694711 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2294694711 >> v1:172.21.15.131:6789/0 conn(0x7f0a280cd5e0 legacy=0x7f0a2806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2294694711 >> v1:172.21.15.28:6789/0 conn(0x7f0a2806fcb0 legacy=0x7f0a28072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2294694711 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280b5520 con 0x7f0a2815b430 2024-09-15T22:55:57.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a2ccd4640 1 --2- 172.21.15.131:0/2294694711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2815b430 0x7f0a280b42b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3fe35207caeb8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a277fe640 1 -- 172.21.15.131:0/2294694711 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0b0070 con 0x7f0a2815b430 2024-09-15T22:55:57.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a277fe640 1 -- 172.21.15.131:0/2294694711 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0ab600 con 0x7f0a2815b430 2024-09-15T22:55:57.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.973+0000 7f0a277fe640 1 -- 172.21.15.131:0/2294694711 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0ab9d0 con 0x7f0a2815b430 2024-09-15T22:55:57.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2294694711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2815b430 msgr2=0x7f0a280b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2294694711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2815b430 0x7f0a280b42b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c01c4d0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2294694711 shutdown_connections 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2294694711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2815b430 0x7f0a280b42b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2294694711 >> 172.21.15.131:0/2294694711 conn(0x7f0a280b2fb0 msgr2=0x7f0a280b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2294694711 shutdown_connections 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2294694711 wait complete. 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 Processor -- start 2024-09-15T22:55:57.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- start start 2024-09-15T22:55:57.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 0x7f0a280d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a2815b430 0x7f0a280d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2806bcc0 con 0x7f0a2815b430 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0a280740b0 con 0x7f0a2806fcb0 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2806be40 con 0x7f0a280cd5e0 2024-09-15T22:55:57.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a27fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 0x7f0a280d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34590/0 (socket says 172.21.15.131:34590) 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2003995265 learned_addr learned my addr 172.21.15.131:0/2003995265 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2d4d5640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a2815b430 0x7f0a280d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 msgr2=0x7f0a280d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 0x7f0a280d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2003995265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a2815b430 msgr2=0x7f0a280d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a2815b430 0x7f0a280d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 -- 172.21.15.131:0/2003995265 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28152c10 con 0x7f0a2806fcb0 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a27fff640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 0x7f0a280d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:57.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ccd4640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0ae040 tx=0x7f0a1c019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0b0040 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0b9070 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0aab90 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a28152eb0 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28155b50 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a1c0ab4c0 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.977+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0a1c0b47f0 con 0x7f0a2806fcb0 2024-09-15T22:55:57.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.981+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a280b42b0 con 0x7f0a2806fcb0 2024-09-15T22:55:57.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:57.981+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0a1c016150 con 0x7f0a2806fcb0 2024-09-15T22:55:58.017 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.018+0000 7f5f396cc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:55:58.038 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:58.037+0000 7fe38f939180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:55:58.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.049+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "717b2c63-937b-410d-b5be-0f7b5cd31216", "id": 1} v 0) -- 0x7f0a28153080 con 0x7f0a2806fcb0 2024-09-15T22:55:58.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a257fa640 1 -- 172.21.15.131:0/2003995265 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "717b2c63-937b-410d-b5be-0f7b5cd31216", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0a1c0aad30 con 0x7f0a2806fcb0 2024-09-15T22:55:58.059 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 msgr2=0x7f0a2815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0ae040 tx=0x7f0a1c019270 comp rx=0 tx=0).stop 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 shutdown_connections 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a2815b430 0x7f0a280d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a280cd5e0 0x7f0a280d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 --2- 172.21.15.131:0/2003995265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a2806fcb0 0x7f0a2815b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 >> 172.21.15.131:0/2003995265 conn(0x7f0a280b2fb0 msgr2=0x7f0a280701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 shutdown_connections 2024-09-15T22:55:58.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.057+0000 7f0a2ef38640 1 -- 172.21.15.131:0/2003995265 wait complete. 2024-09-15T22:55:58.075 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 2da47dbb-c7d9-4b9f-8c8e-65defcdb9341 2 2024-09-15T22:55:58.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 Processor -- start 2024-09-15T22:55:58.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 -- start start 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 0x7ffba0071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba00afec0 con 0x7ffba00b6570 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba00b0160 con 0x7ffba015e610 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffba5d23640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00b0440 con 0x7ffba0073fe0 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ffba015e610 0x7ffba00738d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50262/0 (socket says 172.21.15.131:50262) 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9f7fe640 1 -- 172.21.15.131:0/1626497536 learned_addr learned my addr 172.21.15.131:0/1626497536 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9effd640 1 --2- 172.21.15.131:0/1626497536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 0x7ffba0071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9e7fc640 1 -- 172.21.15.131:0/1626497536 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289497549 0 0) 0x7ffba00b0160 con 0x7ffba015e610 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9e7fc640 1 -- 172.21.15.131:0/1626497536 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c003530 con 0x7ffba015e610 2024-09-15T22:55:58.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9effd640 1 -- 172.21.15.131:0/1626497536 >> v1:172.21.15.131:6789/0 conn(0x7ffba015e610 legacy=0x7ffba00738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9effd640 1 -- 172.21.15.131:0/1626497536 >> v1:172.21.15.28:6789/0 conn(0x7ffba00b6570 legacy=0x7ffba0072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:58.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.189+0000 7ffb9effd640 1 -- 172.21.15.131:0/1626497536 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba00b0720 con 0x7ffba0073fe0 2024-09-15T22:55:58.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9effd640 1 --2- 172.21.15.131:0/1626497536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 0x7ffba0071f30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb880097f0 tx=0x7ffba0073390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed8301b2b1e7957 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9e7fc640 1 -- 172.21.15.131:0/1626497536 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880b0070 con 0x7ffba0073fe0 2024-09-15T22:55:58.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9e7fc640 1 -- 172.21.15.131:0/1626497536 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb880ab600 con 0x7ffba0073fe0 2024-09-15T22:55:58.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9e7fc640 1 -- 172.21.15.131:0/1626497536 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880ab9d0 con 0x7ffba0073fe0 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- 172.21.15.131:0/1626497536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 msgr2=0x7ffba0071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 --2- 172.21.15.131:0/1626497536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 0x7ffba0071f30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb880097f0 tx=0x7ffba0073390 comp rx=0 tx=0).stop 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- 172.21.15.131:0/1626497536 shutdown_connections 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 --2- 172.21.15.131:0/1626497536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba0073fe0 0x7ffba0071f30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- 172.21.15.131:0/1626497536 >> 172.21.15.131:0/1626497536 conn(0x7ffba00b2fb0 msgr2=0x7ffba00b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- 172.21.15.131:0/1626497536 shutdown_connections 2024-09-15T22:55:58.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- 172.21.15.131:0/1626497536 wait complete. 2024-09-15T22:55:58.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 Processor -- start 2024-09-15T22:55:58.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- start start 2024-09-15T22:55:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 0x7ffba0149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 0x7ffba01502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffba016c450 con 0x7ffba0073fe0 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffba016c2d0 con 0x7ffba00b6570 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffba5d23640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffba016c5d0 con 0x7ffba015e610 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9effd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34596/0 (socket says 172.21.15.131:34596) 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9ffff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 0x7ffba01502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.193+0000 7ffb9effd640 1 -- 172.21.15.131:0/4210530487 learned_addr learned my addr 172.21.15.131:0/4210530487 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9f7fe640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 0x7ffba0149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 -- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 msgr2=0x7ffba01502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 0x7ffba01502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 -- 172.21.15.131:0/4210530487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 msgr2=0x7ffba0149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 0x7ffba0149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 -- 172.21.15.131:0/4210530487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba0152c90 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9ffff640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 0x7ffba01502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9f7fe640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 0x7ffba0149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb9effd640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb880097f0 tx=0x7ffb88019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880b8020 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb880b4410 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba014a6b0 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880b0040 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba0152f00 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb880bb020 con 0x7ffba00b6570 2024-09-15T22:55:58.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ffb880bdc30 con 0x7ffba00b6570 2024-09-15T22:55:58.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.197+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba00738d0 con 0x7ffba00b6570 2024-09-15T22:55:58.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.205+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffb880c2030 con 0x7ffba00b6570 2024-09-15T22:55:58.244 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:58.241+0000 7fe38f939180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:55:58.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.273+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2da47dbb-c7d9-4b9f-8c8e-65defcdb9341", "id": 2} v 0) -- 0x7ffba015d6b0 con 0x7ffba00b6570 2024-09-15T22:55:58.281 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffb97fff640 1 -- 172.21.15.131:0/4210530487 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2da47dbb-c7d9-4b9f-8c8e-65defcdb9341", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ffb88016090 con 0x7ffba00b6570 2024-09-15T22:55:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 msgr2=0x7ffba014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb880097f0 tx=0x7ffb88019240 comp rx=0 tx=0).stop 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 shutdown_connections 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffba015e610 0x7ffba01502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffba00b6570 0x7ffba014a090 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 --2- 172.21.15.131:0/4210530487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffba0073fe0 0x7ffba0149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 >> 172.21.15.131:0/4210530487 conn(0x7ffba00b2fb0 msgr2=0x7ffba006fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 shutdown_connections 2024-09-15T22:55:58.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.281+0000 7ffba5d23640 1 -- 172.21.15.131:0/4210530487 wait complete. 2024-09-15T22:55:58.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 71babbc1-5d3d-49a7-996c-f8700485f1e1 3 2024-09-15T22:55:58.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 Processor -- start 2024-09-15T22:55:58.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 -- start start 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 0x7f534c0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f534c0afea0 0x7f534c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534c06f2e0 con 0x7f534c067a00 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f534c06f5c0 con 0x7f534c0afea0 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f535457b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f534c06f8a0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5351b16640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f534c067a00 0x7f534c0cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50276/0 (socket says 172.21.15.131:50276) 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5351b16640 1 -- 172.21.15.131:0/548299825 learned_addr learned my addr 172.21.15.131:0/548299825 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352317640 1 --2- 172.21.15.131:0/548299825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 0x7f534c0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352b18640 1 --2- 172.21.15.131:0/548299825 >> v2:172.21.15.131:3300/0 conn(0x7f534c0afea0 0x7f534c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352317640 1 -- 172.21.15.131:0/548299825 >> v2:172.21.15.131:3300/0 conn(0x7f534c0afea0 msgr2=0x7f534c15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352317640 1 --2- 172.21.15.131:0/548299825 >> v2:172.21.15.131:3300/0 conn(0x7f534c0afea0 0x7f534c15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352317640 1 -- 172.21.15.131:0/548299825 >> v1:172.21.15.131:6789/0 conn(0x7f534c067a00 legacy=0x7f534c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5351315640 1 -- 172.21.15.131:0/548299825 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699159436 0 0) 0x7f534c06f2e0 con 0x7f534c067a00 2024-09-15T22:55:58.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.413+0000 7f5352317640 1 -- 172.21.15.131:0/548299825 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c06fb80 con 0x7f534c0cf7c0 2024-09-15T22:55:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f5352317640 1 --2- 172.21.15.131:0/548299825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 0x7f534c0b5380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097c0 tx=0x7f533c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d04a8d6e5cb0ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f5351315640 1 -- 172.21.15.131:0/548299825 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ab410 con 0x7f534c0cf7c0 2024-09-15T22:55:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f5351315640 1 -- 172.21.15.131:0/548299825 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c0b0070 con 0x7f534c0cf7c0 2024-09-15T22:55:58.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f5351315640 1 -- 172.21.15.131:0/548299825 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ab5d0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 -- 172.21.15.131:0/548299825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 msgr2=0x7f534c0b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 --2- 172.21.15.131:0/548299825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 0x7f534c0b5380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097c0 tx=0x7f533c01c470 comp rx=0 tx=0).stop 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 -- 172.21.15.131:0/548299825 shutdown_connections 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 --2- 172.21.15.131:0/548299825 >> v2:172.21.15.131:3300/0 conn(0x7f534c0afea0 0x7f534c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 --2- 172.21.15.131:0/548299825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0cf7c0 0x7f534c0b5380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 -- 172.21.15.131:0/548299825 >> 172.21.15.131:0/548299825 conn(0x7f534c0716d0 msgr2=0x7f534c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 -- 172.21.15.131:0/548299825 shutdown_connections 2024-09-15T22:55:58.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.417+0000 7f535457b640 1 -- 172.21.15.131:0/548299825 wait complete. 2024-09-15T22:55:58.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 Processor -- start 2024-09-15T22:55:58.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- start start 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f534c067a00 0x7f534c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 0x7f534c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f534c166d50 con 0x7f534c067a00 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f534c166ed0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f534c167050 con 0x7f534c0afea0 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5351b16640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 0x7f534c152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34616/0 (socket says 172.21.15.131:34616) 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5351b16640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 0x7f534c152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:42848/0 (socket says 172.21.15.131:42848) 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 -- 172.21.15.131:0/3424217450 learned_addr learned my addr 172.21.15.131:0/3424217450 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:58.424 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 -- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 msgr2=0x7f534c152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 0x7f534c152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 -- 172.21.15.131:0/3424217450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f534c067a00 msgr2=0x7f534c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f534c067a00 0x7f534c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 -- 172.21.15.131:0/3424217450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c149d50 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5352b18640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5344012420 tx=0x7f53440128e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534400d4e0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534401d070 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534400b980 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c149ff0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c14a5b0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5344016050 con 0x7f534c0cf7c0 2024-09-15T22:55:58.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f53440218a0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.421+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534c14acc0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.425+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5344014040 con 0x7f534c0cf7c0 2024-09-15T22:55:58.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.489+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71babbc1-5d3d-49a7-996c-f8700485f1e1", "id": 3} v 0) -- 0x7f534c15c940 con 0x7f534c0cf7c0 2024-09-15T22:55:58.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f5342ffd640 1 -- 172.21.15.131:0/3424217450 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71babbc1-5d3d-49a7-996c-f8700485f1e1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5344021cb0 con 0x7f534c0cf7c0 2024-09-15T22:55:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-09-15T22:55:58.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 msgr2=0x7f534c147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5344012420 tx=0x7f53440128e0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 shutdown_connections 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f534c0cf7c0 0x7f534c147740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f534c0afea0 0x7f534c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 --2- 172.21.15.131:0/3424217450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f534c067a00 0x7f534c0b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 >> 172.21.15.131:0/3424217450 conn(0x7f534c0716d0 msgr2=0x7f534c15dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 shutdown_connections 2024-09-15T22:55:58.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.493+0000 7f535457b640 1 -- 172.21.15.131:0/3424217450 wait complete. 2024-09-15T22:55:58.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 7710215d-614e-4055-9384-ea354564e681 4 2024-09-15T22:55:58.601 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.602+0000 7f5f396cc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:55:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.617+0000 7fe2a4945640 1 Processor -- start 2024-09-15T22:55:58.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.617+0000 7fe2a4945640 1 -- start start 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a00cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2a01606d0 0x7fe2a00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a015c9b0 con 0x7fe2a00cfc40 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a015d770 con 0x7fe2a01606d0 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a015d2e0 con 0x7fe2a0153150 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29dd9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe2a00cfc40 0x7fe2a015ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50290/0 (socket says 172.21.15.131:50290) 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a00cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29dd9b640 1 -- 172.21.15.131:0/3248691117 learned_addr learned my addr 172.21.15.131:0/3248691117 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29ed9d640 1 --2- 172.21.15.131:0/3248691117 >> v2:172.21.15.28:3300/0 conn(0x7fe2a01606d0 0x7fe2a00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29d59a640 1 -- 172.21.15.131:0/3248691117 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935849923 0 0) 0x7fe2a015c9b0 con 0x7fe2a00cfc40 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 -- 172.21.15.131:0/3248691117 >> v2:172.21.15.28:3300/0 conn(0x7fe2a01606d0 msgr2=0x7fe2a00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 --2- 172.21.15.131:0/3248691117 >> v2:172.21.15.28:3300/0 conn(0x7fe2a01606d0 0x7fe2a00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 -- 172.21.15.131:0/3248691117 >> v1:172.21.15.131:6789/0 conn(0x7fe2a00cfc40 legacy=0x7fe2a015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 -- 172.21.15.131:0/3248691117 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a015cc90 con 0x7fe2a0153150 2024-09-15T22:55:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29e59c640 1 --2- 172.21.15.131:0/3248691117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a00cf700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c7126f31fd808c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29d59a640 1 -- 172.21.15.131:0/3248691117 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b0070 con 0x7fe2a0153150 2024-09-15T22:55:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29d59a640 1 -- 172.21.15.131:0/3248691117 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2900ab600 con 0x7fe2a0153150 2024-09-15T22:55:58.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe29d59a640 1 -- 172.21.15.131:0/3248691117 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900ab9d0 con 0x7fe2a0153150 2024-09-15T22:55:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- 172.21.15.131:0/3248691117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 msgr2=0x7fe2a00cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3248691117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a00cf700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- 172.21.15.131:0/3248691117 shutdown_connections 2024-09-15T22:55:58.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3248691117 >> v2:172.21.15.28:3300/0 conn(0x7fe2a01606d0 0x7fe2a00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3248691117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a00cf700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- 172.21.15.131:0/3248691117 >> 172.21.15.131:0/3248691117 conn(0x7fe2a00b08e0 msgr2=0x7fe2a00b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.621+0000 7fe2a4945640 1 -- 172.21.15.131:0/3248691117 shutdown_connections 2024-09-15T22:55:58.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- 172.21.15.131:0/3248691117 wait complete. 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 Processor -- start 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- start start 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a01606d0 0x7fe2a0150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a00b4a00 con 0x7fe2a01606d0 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0153740 con 0x7fe2a00cfc40 2024-09-15T22:55:58.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a00b4b80 con 0x7fe2a0153150 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29dd9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34628/0 (socket says 172.21.15.131:34628) 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29dd9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:42864/0 (socket says 172.21.15.131:42864) 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 -- 172.21.15.131:0/3997044409 learned_addr learned my addr 172.21.15.131:0/3997044409 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29ed9d640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a01606d0 0x7fe2a0150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 -- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 msgr2=0x7fe2a014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 -- 172.21.15.131:0/3997044409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a01606d0 msgr2=0x7fe2a0150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a01606d0 0x7fe2a0150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 -- 172.21.15.131:0/3997044409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01f7830 con 0x7fe2a00cfc40 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29dd9b640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:58.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe29e59c640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ae040 tx=0x7fe29001ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b0050 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2900bc070 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a01f7550 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b5850 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a015e740 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2900b59f0 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe2900b7450 con 0x7fe2a00cfc40 2024-09-15T22:55:58.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.625+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a00cf6d0 con 0x7fe2a00cfc40 2024-09-15T22:55:58.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.629+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe290016090 con 0x7fe2a00cfc40 2024-09-15T22:55:58.658 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.658+0000 7f5f396cc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:55:58.713 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.714+0000 7f5f396cc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:55:58.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.765+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7710215d-614e-4055-9384-ea354564e681", "id": 4} v 0) -- 0x7fe2a00754d0 con 0x7fe2a00cfc40 2024-09-15T22:55:58.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.769+0000 7fe28effd640 1 -- 172.21.15.131:0/3997044409 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7710215d-614e-4055-9384-ea354564e681", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe2900b5d30 con 0x7fe2a00cfc40 2024-09-15T22:55:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:4 2024-09-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 msgr2=0x7fe2a015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ae040 tx=0x7fe29001ace0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 shutdown_connections 2024-09-15T22:55:58.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a01606d0 0x7fe2a0150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a0153150 0x7fe2a014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 --2- 172.21.15.131:0/3997044409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a00cfc40 0x7fe2a015ef40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 >> 172.21.15.131:0/3997044409 conn(0x7fe2a00b08e0 msgr2=0x7fe2a006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 shutdown_connections 2024-09-15T22:55:58.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.773+0000 7fe2a4945640 1 -- 172.21.15.131:0/3997044409 wait complete. 2024-09-15T22:55:58.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new de18fdfa-3ae6-4b53-beb7-fe3927145a4b 5 2024-09-15T22:55:58.795 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.794+0000 7f5f396cc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:55:58.849 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.850+0000 7f5f396cc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:55:58.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 Processor -- start 2024-09-15T22:55:58.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 -- start start 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 0x7f194c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f194c15e7f0 0x7f194c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194c0b65f0 con 0x7f194c0b5380 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f194c15ece0 con 0x7f194c15e7f0 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f1951d32640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f194c15efc0 con 0x7f194c15e410 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194b7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 0x7f194c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194bfff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f194c0b5380 0x7f194c161f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50304/0 (socket says 172.21.15.131:50304) 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194bfff640 1 -- 172.21.15.131:0/2223861343 learned_addr learned my addr 172.21.15.131:0/2223861343 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:58.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194affd640 1 --2- 172.21.15.131:0/2223861343 >> v2:172.21.15.28:3300/0 conn(0x7f194c15e7f0 0x7f194c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194a7fc640 1 -- 172.21.15.131:0/2223861343 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503654812 0 0) 0x7f194c0b65f0 con 0x7f194c0b5380 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194a7fc640 1 -- 172.21.15.131:0/2223861343 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1934003530 con 0x7f194c0b5380 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194b7fe640 1 -- 172.21.15.131:0/2223861343 >> v2:172.21.15.28:3300/0 conn(0x7f194c15e7f0 msgr2=0x7f194c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194b7fe640 1 --2- 172.21.15.131:0/2223861343 >> v2:172.21.15.28:3300/0 conn(0x7f194c15e7f0 0x7f194c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194b7fe640 1 -- 172.21.15.131:0/2223861343 >> v1:172.21.15.131:6789/0 conn(0x7f194c0b5380 legacy=0x7f194c161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.901+0000 7f194b7fe640 1 -- 172.21.15.131:0/2223861343 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c15f2a0 con 0x7f194c15e410 2024-09-15T22:55:58.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f194b7fe640 1 --2- 172.21.15.131:0/2223861343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 0x7f194c0cf7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097c0 tx=0x7f193c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63810436487487eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f194a7fc640 1 -- 172.21.15.131:0/2223861343 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0b5070 con 0x7f194c15e410 2024-09-15T22:55:58.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f194a7fc640 1 -- 172.21.15.131:0/2223861343 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c0a8990 con 0x7f194c15e410 2024-09-15T22:55:58.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f194a7fc640 1 -- 172.21.15.131:0/2223861343 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a8d60 con 0x7f194c15e410 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- 172.21.15.131:0/2223861343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 msgr2=0x7f194c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 --2- 172.21.15.131:0/2223861343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 0x7f194c0cf7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097c0 tx=0x7f193c01ec90 comp rx=0 tx=0).stop 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- 172.21.15.131:0/2223861343 shutdown_connections 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 --2- 172.21.15.131:0/2223861343 >> v2:172.21.15.28:3300/0 conn(0x7f194c15e7f0 0x7f194c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 --2- 172.21.15.131:0/2223861343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e410 0x7f194c0cf7e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- 172.21.15.131:0/2223861343 >> 172.21.15.131:0/2223861343 conn(0x7f194c0716d0 msgr2=0x7f194c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- 172.21.15.131:0/2223861343 shutdown_connections 2024-09-15T22:55:58.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- 172.21.15.131:0/2223861343 wait complete. 2024-09-15T22:55:58.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 Processor -- start 2024-09-15T22:55:58.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.905+0000 7f1951d32640 1 -- start start 2024-09-15T22:55:58.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f194c0b5380 0x7f194c1f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c15e410 0x7f194c1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:58.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f194c160950 con 0x7f194c0b5380 2024-09-15T22:55:58.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1607d0 con 0x7f194c15e410 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f194c160ad0 con 0x7f194c15e7f0 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c15e410 0x7f194c1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:42882/0 (socket says 172.21.15.131:42882) 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 -- 172.21.15.131:0/607599915 learned_addr learned my addr 172.21.15.131:0/607599915 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194b7fe640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f194c0b5380 0x7f194c1f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 -- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c15e410 msgr2=0x7f194c1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c15e410 0x7f194c1f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 -- 172.21.15.131:0/607599915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f194c0b5380 msgr2=0x7f194c1f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f194c0b5380 0x7f194c1f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 -- 172.21.15.131:0/607599915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c0af150 con 0x7f194c15e7f0 2024-09-15T22:55:58.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f194bfff640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f194400cb40 tx=0x7f194400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:58.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944017070 con 0x7f194c15e7f0 2024-09-15T22:55:58.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194400aca0 con 0x7f194c15e7f0 2024-09-15T22:55:58.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944012620 con 0x7f194c15e7f0 2024-09-15T22:55:58.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c1f4c60 con 0x7f194c15e7f0 2024-09-15T22:55:58.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1f5220 con 0x7f194c15e7f0 2024-09-15T22:55:58.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f194401a070 con 0x7f194c15e7f0 2024-09-15T22:55:58.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f19440075f0 con 0x7f194c15e7f0 2024-09-15T22:55:58.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.909+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c0cf7e0 con 0x7f194c15e7f0 2024-09-15T22:55:58.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.913+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1944021070 con 0x7f194c15e7f0 2024-09-15T22:55:58.919 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:58.917+0000 7fe38f939180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:55:58.930 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.930+0000 7f5f396cc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:55:58.977 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:58.973+0000 7fe38f939180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:55:58.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.977+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de18fdfa-3ae6-4b53-beb7-fe3927145a4b", "id": 5} v 0) -- 0x7f194c0af320 con 0x7f194c15e7f0 2024-09-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.981+0000 7f1933fff640 1 -- 172.21.15.131:0/607599915 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de18fdfa-3ae6-4b53-beb7-fe3927145a4b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1944007860 con 0x7f194c15e7f0 2024-09-15T22:55:58.985 INFO:teuthology.orchestra.run.smithi131.stdout:5 2024-09-15T22:55:58.985 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:58.986+0000 7f5f396cc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 msgr2=0x7f194c1f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:58.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f194400cb40 tx=0x7f194400a060 comp rx=0 tx=0).stop 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 shutdown_connections 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f194c15e7f0 0x7f194c1f5500 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f194c15e410 0x7f194c1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 --2- 172.21.15.131:0/607599915 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f194c0b5380 0x7f194c1f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 >> 172.21.15.131:0/607599915 conn(0x7f194c0716d0 msgr2=0x7f194c0cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 shutdown_connections 2024-09-15T22:55:58.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:58.985+0000 7f1951d32640 1 -- 172.21.15.131:0/607599915 wait complete. 2024-09-15T22:55:59.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new aae72c2c-a564-4160-a5c8-139a3d3256e3 6 2024-09-15T22:55:59.033 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.033+0000 7fe38f939180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:55:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 Processor -- start 2024-09-15T22:55:59.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 -- start start 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 0x7f58ac15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 0x7f58ac0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ac0b3b00 con 0x7f58ac0aff30 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f58ac0b3de0 con 0x7f58ac158b50 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58b2252640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac0b40c0 con 0x7f58ac0cede0 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58ab7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 0x7f58ac15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58abfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 0x7f58ac0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58aaffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f58ac0aff30 0x7f58ac0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:50320/0 (socket says 172.21.15.131:50320) 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58aaffd640 1 -- 172.21.15.131:0/769906385 learned_addr learned my addr 172.21.15.131:0/769906385 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58abfff640 1 -- 172.21.15.131:0/769906385 >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 msgr2=0x7f58ac15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58abfff640 1 --2- 172.21.15.131:0/769906385 >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 0x7f58ac15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58abfff640 1 -- 172.21.15.131:0/769906385 >> v1:172.21.15.131:6789/0 conn(0x7f58ac0aff30 legacy=0x7f58ac0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58aa7fc640 1 -- 172.21.15.131:0/769906385 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064857198 0 0) 0x7f58ac0b3b00 con 0x7f58ac0aff30 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58abfff640 1 -- 172.21.15.131:0/769906385 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0b43a0 con 0x7f58ac0cede0 2024-09-15T22:55:59.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.109+0000 7f58ab7fe640 1 --2- 172.21.15.131:0/769906385 >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 0x7f58ac15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:59.114 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.113+0000 7fe38f939180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:55:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58abfff640 1 --2- 172.21.15.131:0/769906385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 0x7f58ac0b48c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009d90 tx=0x7f58a401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c30ccc07ef5fff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58aa7fc640 1 -- 172.21.15.131:0/769906385 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b2070 con 0x7f58ac0cede0 2024-09-15T22:55:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58aa7fc640 1 -- 172.21.15.131:0/769906385 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a40a5980 con 0x7f58ac0cede0 2024-09-15T22:55:59.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58aa7fc640 1 -- 172.21.15.131:0/769906385 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a40a5d50 con 0x7f58ac0cede0 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- 172.21.15.131:0/769906385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 msgr2=0x7f58ac0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 --2- 172.21.15.131:0/769906385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 0x7f58ac0b48c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009d90 tx=0x7f58a401c970 comp rx=0 tx=0).stop 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- 172.21.15.131:0/769906385 shutdown_connections 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 --2- 172.21.15.131:0/769906385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac0cede0 0x7f58ac0b48c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 --2- 172.21.15.131:0/769906385 >> v2:172.21.15.131:3300/0 conn(0x7f58ac158b50 0x7f58ac15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- 172.21.15.131:0/769906385 >> 172.21.15.131:0/769906385 conn(0x7f58ac0b06d0 msgr2=0x7f58ac0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- 172.21.15.131:0/769906385 shutdown_connections 2024-09-15T22:55:59.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- 172.21.15.131:0/769906385 wait complete. 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 Processor -- start 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.113+0000 7f58b2252640 1 -- start start 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f58ac0aff30 0x7f58ac154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 0x7f58ac0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 0x7f58ac15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0b5790 con 0x7f58ac0aff30 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0b5610 con 0x7f58ac0cede0 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac0b5910 con 0x7f58ac158b50 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58aaffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 0x7f58ac0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 0x7f58ac15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58aaffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 0x7f58ac0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34664/0 (socket says 172.21.15.131:34664) 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58aaffd640 1 -- 172.21.15.131:0/3263023648 learned_addr learned my addr 172.21.15.131:0/3263023648 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58ab7fe640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f58ac0aff30 0x7f58ac154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 -- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 msgr2=0x7f58ac0ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 0x7f58ac0ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 -- 172.21.15.131:0/3263023648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f58ac0aff30 msgr2=0x7f58ac154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f58ac0aff30 0x7f58ac154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 -- 172.21.15.131:0/3263023648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac15cd40 con 0x7f58ac158b50 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58abfff640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 0x7f58ac15a650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58a40ac000 tx=0x7f58a4019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a40bd020 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a40b3040 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b2050 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac0aeed0 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac15d2c0 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58a40ad650 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f58a4004760 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.117+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac0b48c0 con 0x7f58ac158b50 2024-09-15T22:55:59.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.121+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f58a40c7060 con 0x7f58ac158b50 2024-09-15T22:55:59.144 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:59.146+0000 7f5f396cc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:55:59.168 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.165+0000 7fe38f939180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:55:59.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.189+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aae72c2c-a564-4160-a5c8-139a3d3256e3", "id": 6} v 0) -- 0x7f58ac0ceae0 con 0x7f58ac158b50 2024-09-15T22:55:59.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f5893fff640 1 -- 172.21.15.131:0/3263023648 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aae72c2c-a564-4160-a5c8-139a3d3256e3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f58a4016560 con 0x7f58ac158b50 2024-09-15T22:55:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:6 2024-09-15T22:55:59.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 msgr2=0x7f58ac15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 0x7f58ac15a650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58a40ac000 tx=0x7f58a4019710 comp rx=0 tx=0).stop 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 shutdown_connections 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58ac158b50 0x7f58ac15a650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58ac0cede0 0x7f58ac0ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 --2- 172.21.15.131:0/3263023648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f58ac0aff30 0x7f58ac154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 >> 172.21.15.131:0/3263023648 conn(0x7f58ac0b06d0 msgr2=0x7f58ac160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 shutdown_connections 2024-09-15T22:55:59.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.197+0000 7f58b2252640 1 -- 172.21.15.131:0/3263023648 wait complete. 2024-09-15T22:55:59.209 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:59.210+0000 7f5f396cc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:55:59.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c 7 2024-09-15T22:55:59.249 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.245+0000 7fe38f939180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:55:59.303 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.301+0000 7fe38f939180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:55:59.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.357+0000 7f8cd49c3640 1 Processor -- start 2024-09-15T22:55:59.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.357+0000 7f8cd49c3640 1 -- start start 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cd0073c40 0x7f8cd006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd0071fb0 con 0x7f8cd0072d70 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd0072290 con 0x7f8cd0073c40 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd0072570 con 0x7f8cd015afb0 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:42908/0 (socket says 172.21.15.131:42908) 2024-09-15T22:55:59.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 -- 172.21.15.131:0/2262154138 learned_addr learned my addr 172.21.15.131:0/2262154138 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:59.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 -- 172.21.15.131:0/2262154138 >> v2:172.21.15.28:3300/0 conn(0x7f8cd0073c40 msgr2=0x7f8cd006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 --2- 172.21.15.131:0/2262154138 >> v2:172.21.15.28:3300/0 conn(0x7f8cd0073c40 0x7f8cd006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 -- 172.21.15.131:0/2262154138 >> v1:172.21.15.28:6789/0 conn(0x7f8cd0072d70 legacy=0x7f8cd0073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 -- 172.21.15.131:0/2262154138 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd0074260 con 0x7f8cd015afb0 2024-09-15T22:55:59.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cce59c640 1 --2- 172.21.15.131:0/2262154138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009870 tx=0x7f8cc001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d80aebd809f33d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8ccdd9b640 1 -- 172.21.15.131:0/2262154138 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00b5070 con 0x7f8cd015afb0 2024-09-15T22:55:59.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8ccdd9b640 1 -- 172.21.15.131:0/2262154138 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00a89d0 con 0x7f8cd015afb0 2024-09-15T22:55:59.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8ccdd9b640 1 -- 172.21.15.131:0/2262154138 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00a8da0 con 0x7f8cd015afb0 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- 172.21.15.131:0/2262154138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 msgr2=0x7f8cd006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/2262154138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009870 tx=0x7f8cc001ed10 comp rx=0 tx=0).stop 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- 172.21.15.131:0/2262154138 shutdown_connections 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/2262154138 >> v2:172.21.15.28:3300/0 conn(0x7f8cd0073c40 0x7f8cd006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/2262154138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd006f6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- 172.21.15.131:0/2262154138 >> 172.21.15.131:0/2262154138 conn(0x7f8cd00b2fb0 msgr2=0x7f8cd00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- 172.21.15.131:0/2262154138 shutdown_connections 2024-09-15T22:55:59.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.361+0000 7f8cd49c3640 1 -- 172.21.15.131:0/2262154138 wait complete. 2024-09-15T22:55:59.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 Processor -- start 2024-09-15T22:55:59.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- start start 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 0x7f8cd015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd0158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00b4430 con 0x7f8cd0073c40 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00b42b0 con 0x7f8cd0072d70 2024-09-15T22:55:59.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd00b45b0 con 0x7f8cd015afb0 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34680/0 (socket says 172.21.15.131:34680) 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cce59c640 1 -- 172.21.15.131:0/67649376 learned_addr learned my addr 172.21.15.131:0/67649376 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc7fff640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 0x7f8cd015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 -- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 msgr2=0x7f8cd01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 -- 172.21.15.131:0/67649376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 msgr2=0x7f8cd015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 0x7f8cd015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 -- 172.21.15.131:0/67649376 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd0151f30 con 0x7f8cd015afb0 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cce59c640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc7fff640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 0x7f8cd015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:59.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cced9d640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd0158890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800be20 tx=0x7f8cc800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8019070 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc8014440 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd0152210 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8014830 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01527d0 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cc801c070 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8cc801da10 con 0x7f8cd015afb0 2024-09-15T22:55:59.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.365+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd0073530 con 0x7f8cd015afb0 2024-09-15T22:55:59.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.369+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8cc8023020 con 0x7f8cd015afb0 2024-09-15T22:55:59.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.437+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c", "id": 7} v 0) -- 0x7f8cd00b21f0 con 0x7f8cd015afb0 2024-09-15T22:55:59.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cc6ffd640 1 -- 172.21.15.131:0/67649376 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8cc801e440 con 0x7f8cd015afb0 2024-09-15T22:55:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:7 2024-09-15T22:55:59.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 msgr2=0x7f8cd0158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd0158890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800be20 tx=0x7f8cc800bf10 comp rx=0 tx=0).stop 2024-09-15T22:55:59.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 shutdown_connections 2024-09-15T22:55:59.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cd015afb0 0x7f8cd0158890 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.445 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cd0073c40 0x7f8cd015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 --2- 172.21.15.131:0/67649376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cd0072d70 0x7f8cd01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.441+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 >> 172.21.15.131:0/67649376 conn(0x7f8cd00b2fb0 msgr2=0x7f8cd00b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.445+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 shutdown_connections 2024-09-15T22:55:59.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:55:59.445+0000 7f8cd49c3640 1 -- 172.21.15.131:0/67649376 wait complete. 2024-09-15T22:55:59.460 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T22:55:59.461 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T22:55:59.462 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.461+0000 7fe38f939180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:55:59.463 INFO:tasks.ceph.osd.0:Started 2024-09-15T22:55:59.463 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T22:55:59.463 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T22:55:59.466 INFO:tasks.ceph.osd.1:Started 2024-09-15T22:55:59.466 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T22:55:59.466 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T22:55:59.468 INFO:tasks.ceph.osd.2:Started 2024-09-15T22:55:59.468 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T22:55:59.468 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T22:55:59.470 INFO:tasks.ceph.osd.3:Started 2024-09-15T22:55:59.471 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T22:55:59.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T22:55:59.473 INFO:tasks.ceph.osd.4:Started 2024-09-15T22:55:59.473 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T22:55:59.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T22:55:59.475 INFO:tasks.ceph.osd.5:Started 2024-09-15T22:55:59.476 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T22:55:59.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T22:55:59.478 INFO:tasks.ceph.osd.6:Started 2024-09-15T22:55:59.478 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T22:55:59.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T22:55:59.480 INFO:tasks.ceph.osd.7:Started 2024-09-15T22:55:59.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:55:59.551 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:55:59.549+0000 7fe38f939180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:55:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 Processor -- start 2024-09-15T22:55:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 -- start start 2024-09-15T22:55:59.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f63e40b4220 0x7f63e4073d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40b5110 con 0x7f63e415af30 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e4073230 con 0x7f63e406e5f0 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e8840640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f63e4073510 con 0x7f63e40b4220 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f63e415af30 0x7f63e406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57842/0 (socket says 172.21.15.28:57842) 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e259c640 1 -- 172.21.15.28:0/1308691345 learned_addr learned my addr 172.21.15.28:0/1308691345 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407806242 0 0) 0x7f63e40b5110 con 0x7f63e415af30 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d0003530 con 0x7f63e415af30 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/1308691345 >> v2:172.21.15.131:3300/0 conn(0x7f63e40b4220 0x7f63e4073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2345567260 0 0) 0x7f63d0003530 con 0x7f63e415af30 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 >> v2:172.21.15.131:3300/0 conn(0x7f63e40b4220 msgr2=0x7f63e4073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 --2- 172.21.15.28:0/1308691345 >> v2:172.21.15.131:3300/0 conn(0x7f63e40b4220 0x7f63e4073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 >> v1:172.21.15.131:6789/0 conn(0x7f63e406e5f0 legacy=0x7f63e415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40b53f0 con 0x7f63e415af30 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f63d4001680 con 0x7f63e415af30 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 >> v1:172.21.15.28:6789/0 conn(0x7f63e415af30 legacy=0x7f63e406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d00039c0 0x7f63d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 0x7f63d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d00053d0 0x7f63d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4073510 con 0x7f63d0004810 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63d000c260 con 0x7f63d00053d0 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63d000e670 con 0x7f63d00039c0 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 0x7f63d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e259c640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d00039c0 0x7f63d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e2d9d640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d00053d0 0x7f63d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 -- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d00039c0 msgr2=0x7f63d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d00039c0 0x7f63d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 -- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d00053d0 msgr2=0x7f63d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d00053d0 0x7f63d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e1d9b640 1 -- 172.21.15.28:0/1308691345 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d0003530 con 0x7f63d0004810 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e259c640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d00039c0 0x7f63d0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e2d9d640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d00053d0 0x7f63d000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.650+0000 7f63e2d9d640 1 -- 172.21.15.28:0/1308691345 reap_dead start 2024-09-15T22:55:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 0x7f63d0004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00ba30 tx=0x7f63cc01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ba32e5e5decfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0b3070 con 0x7f63d0004810 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc0ae630 con 0x7f63d0004810 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e159a640 1 -- 172.21.15.28:0/1308691345 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0aa050 con 0x7f63d0004810 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 msgr2=0x7f63d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 0x7f63d0004c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00ba30 tx=0x7f63cc01c6a0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- 172.21.15.28:0/1308691345 shutdown_connections 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 --2- 172.21.15.28:0/1308691345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d0004810 0x7f63d0004c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- 172.21.15.28:0/1308691345 >> 172.21.15.28:0/1308691345 conn(0x7f63e4067bd0 msgr2=0x7f63e406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- 172.21.15.28:0/1308691345 shutdown_connections 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- 172.21.15.28:0/1308691345 wait complete. 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 Processor -- start 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.654+0000 7f63e8840640 1 -- start start 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 0x7f63e41506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 0x7f63e4152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63e406e270 con 0x7f63e4142d40 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63e406e0f0 con 0x7f63d0004810 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63e406e3f0 con 0x7f63e406c470 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44968/0 (socket says 172.21.15.28:44968) 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 -- 172.21.15.28:0/2321253397 learned_addr learned my addr 172.21.15.28:0/2321253397 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e259c640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 0x7f63e41506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e2d9d640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 0x7f63e4152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 -- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 msgr2=0x7f63e4152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 0x7f63e4152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 -- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 msgr2=0x7f63e41506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 0x7f63e41506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 -- 172.21.15.28:0/2321253397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4155130 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e2d9d640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 0x7f63e4152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e259c640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 0x7f63e41506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e1d9b640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0b1040 tx=0x7f63d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0b3040 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc004020 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00b600 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e4155410 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e41559d0 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63cc003620 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f63cc0b9b50 con 0x7f63e4142d40 2024-09-15T22:55:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.658+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e415f470 con 0x7f63e4142d40 2024-09-15T22:55:59.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.662+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f63cc0163b0 con 0x7f63e4142d40 2024-09-15T22:55:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63e4159200 con 0x7f63e4142d40 2024-09-15T22:55:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63daffd640 1 -- 172.21.15.28:0/2321253397 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f63cc0b9df0 con 0x7f63e4142d40 2024-09-15T22:55:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:55:59.718 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:55:59.442387+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 msgr2=0x7f63e406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0b1040 tx=0x7f63d0005840 comp rx=0 tx=0).stop 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 shutdown_connections 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63e406c470 0x7f63e4152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e4142d40 0x7f63e406bf30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 --2- 172.21.15.28:0/2321253397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d0004810 0x7f63e41506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:59.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 >> 172.21.15.28:0/2321253397 conn(0x7f63e4067bd0 msgr2=0x7f63e415c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:59.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 shutdown_connections 2024-09-15T22:55:59.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:55:59.718+0000 7f63e8840640 1 -- 172.21.15.28:0/2321253397 wait complete. 2024-09-15T22:55:59.734 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T22:55:59.735 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T22:55:59.883 INFO:tasks.ceph.mgr.y.smithi028.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T22:55:59.883 INFO:tasks.ceph.mgr.y.smithi028.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T22:55:59.883 INFO:tasks.ceph.mgr.y.smithi028.stderr: from numpy import show_config as show_numpy_config 2024-09-15T22:55:59.920 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:55:59.922+0000 7f5f396cc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:56:00.061 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:00.062+0000 7f5f396cc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:56:00.219 INFO:tasks.ceph.mgr.x.smithi131.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T22:56:00.219 INFO:tasks.ceph.mgr.x.smithi131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T22:56:00.219 INFO:tasks.ceph.mgr.x.smithi131.stderr: from numpy import show_config as show_numpy_config 2024-09-15T22:56:00.219 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:00.218+0000 7f5f396cc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:56:00.282 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:00.281+0000 7fe38f939180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:56:00.285 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:00.286+0000 7f5f396cc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:56:00.427 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:00.426+0000 7f5f396cc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:56:00.438 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:00.437+0000 7fe38f939180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:56:00.541 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:00.609 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:00.605+0000 7fe38f939180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:56:00.651 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.650+0000 7f25260b5640 1 Processor -- start 2024-09-15T22:56:00.651 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.650+0000 7f25260b5640 1 -- start start 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f252015e750 0x7f25200cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25200d0810 0x7f25200736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25200b4350 0x7f2520073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f25200cf2c0 con 0x7f25200d0810 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f25200cef90 con 0x7f25200b4350 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2520072cd0 con 0x7f252015e750 2024-09-15T22:56:00.653 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25200d0810 0x7f25200736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25200d0810 0x7f25200736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44972/0 (socket says 172.21.15.28:44972) 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 -- 172.21.15.28:0/1350222356 learned_addr learned my addr 172.21.15.28:0/1350222356 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251ffff640 1 --2- 172.21.15.28:0/1350222356 >> v2:172.21.15.131:3300/0 conn(0x7f25200b4350 0x7f2520073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251f7fe640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f252015e750 0x7f25200cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 -- 172.21.15.28:0/1350222356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f252015e750 msgr2=0x7f25200cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f252015e750 0x7f25200cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 -- 172.21.15.28:0/1350222356 >> v2:172.21.15.131:3300/0 conn(0x7f25200b4350 msgr2=0x7f2520073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 --2- 172.21.15.28:0/1350222356 >> v2:172.21.15.131:3300/0 conn(0x7f25200b4350 0x7f2520073be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.654 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 -- 172.21.15.28:0/1350222356 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2520072fb0 con 0x7f25200d0810 2024-09-15T22:56:00.655 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251effd640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f25200736a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25200b0ce0 tx=0x7f251401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bbcc234fc13ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:00.655 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251e7fc640 1 -- 172.21.15.28:0/1350222356 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25140b4070 con 0x7f25200d0810 2024-09-15T22:56:00.655 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251e7fc640 1 -- 172.21.15.28:0/1350222356 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25140a7aa0 con 0x7f25200d0810 2024-09-15T22:56:00.655 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f251e7fc640 1 -- 172.21.15.28:0/1350222356 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25140af440 con 0x7f25200d0810 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 -- 172.21.15.28:0/1350222356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 msgr2=0x7f25200736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.654+0000 7f25260b5640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f25200736a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25200b0ce0 tx=0x7f251401ebf0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/1350222356 shutdown_connections 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- 172.21.15.28:0/1350222356 >> v2:172.21.15.131:3300/0 conn(0x7f25200b4350 0x7f2520073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f25200736a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- 172.21.15.28:0/1350222356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f252015e750 0x7f25200cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.656 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/1350222356 >> 172.21.15.28:0/1350222356 conn(0x7f252006e150 msgr2=0x7f252006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:00.657 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/1350222356 shutdown_connections 2024-09-15T22:56:00.657 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/1350222356 wait complete. 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 Processor -- start 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- start start 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 0x7f2520149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f252015e750 0x7f2520162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f252015f890 con 0x7f25200d0810 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f252015f710 con 0x7f252015e750 2024-09-15T22:56:00.659 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f252015fa10 con 0x7f25200b4350 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44980/0 (socket says 172.21.15.28:44980) 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 -- 172.21.15.28:0/3831676985 learned_addr learned my addr 172.21.15.28:0/3831676985 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251ffff640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f252015e750 0x7f2520162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251f7fe640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 0x7f2520149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 -- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 msgr2=0x7f2520149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 0x7f2520149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.660 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 -- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f252015e750 msgr2=0x7f2520162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f252015e750 0x7f2520162ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 -- 172.21.15.28:0/3831676985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2520160380 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251f7fe640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 0x7f2520149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f251effd640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f251401d2a0 tx=0x7f251401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25140b4040 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25140af820 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2520152560 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25140afc10 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2520160900 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f25140b8430 con 0x7f25200d0810 2024-09-15T22:56:00.661 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.658+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f25140afdb0 con 0x7f25200d0810 2024-09-15T22:56:00.662 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.662+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25200cd900 con 0x7f25200d0810 2024-09-15T22:56:00.662 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.662+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f25140187e0 con 0x7f25200d0810 2024-09-15T22:56:00.679 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:00.677+0000 7fe38f939180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:56:00.728 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f252004ffc0 con 0x7f25200d0810 2024-09-15T22:56:00.729 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f2507fff640 1 -- 172.21.15.28:0/3831676985 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f25140c3400 con 0x7f25200d0810 2024-09-15T22:56:00.729 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-15T22:56:00.729 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:55:59.442387+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 msgr2=0x7f2520151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f251401d2a0 tx=0x7f251401b990 comp rx=0 tx=0).stop 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 shutdown_connections 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f252015e750 0x7f2520162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25200d0810 0x7f2520151c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 --2- 172.21.15.28:0/3831676985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25200b4350 0x7f2520149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 >> 172.21.15.28:0/3831676985 conn(0x7f252006e150 msgr2=0x7f25200cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 shutdown_connections 2024-09-15T22:56:00.730 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:00.730+0000 7f25260b5640 1 -- 172.21.15.28:0/3831676985 wait complete. 2024-09-15T22:56:00.743 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:56:00.827 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:00.825+0000 7fe38f939180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:56:00.937 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-15T22:56:00.938+0000 7fa4424167c0 -1 Falling back to public interface 2024-09-15T22:56:01.094 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.094+0000 7f5f396cc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:56:01.112 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-15T22:56:01.114+0000 7fa6cc9ed7c0 -1 Falling back to public interface 2024-09-15T22:56:01.126 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-15T22:56:01.125+0000 7effa102f7c0 -1 Falling back to public interface 2024-09-15T22:56:01.177 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.178+0000 7f5f396cc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:56:01.196 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-15T22:56:01.198+0000 7f9cd06957c0 -1 Falling back to public interface 2024-09-15T22:56:01.251 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-15T22:56:01.249+0000 7f85d62e27c0 -1 Falling back to public interface 2024-09-15T22:56:01.372 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.374+0000 7f5f396cc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:56:01.399 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-15T22:56:01.397+0000 7fc84ec3e7c0 -1 Falling back to public interface 2024-09-15T22:56:01.449 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.450+0000 7f5f396cc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:56:01.454 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:01.453+0000 7fe38f939180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:56:01.529 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:01.525+0000 7fe38f939180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:56:01.623 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-15T22:56:01.621+0000 7f2b2f16d7c0 -1 Falling back to public interface 2024-09-15T22:56:01.645 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-15T22:56:01.646+0000 7ff32c4607c0 -1 Falling back to public interface 2024-09-15T22:56:01.713 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:01.709+0000 7fe38f939180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:56:01.758 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.758+0000 7f5f396cc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:56:01.787 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:01.785+0000 7fe38f939180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:56:01.823 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:01.822+0000 7f5f396cc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:56:02.090 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:02.089+0000 7fe38f939180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:56:02.154 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-15T22:56:02.153+0000 7fe38f939180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:56:02.867 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:02.866+0000 7f5ee0200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:56:02.868 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-09-15T22:56:02.870+0000 7f5ee0200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T22:56:05.220 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-15T22:56:05.220+0000 7effa102f7c0 -1 osd.4 0 log_to_monitors true 2024-09-15T22:56:05.330 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-15T22:56:05.330+0000 7fa4424167c0 -1 osd.0 0 log_to_monitors true 2024-09-15T22:56:05.716 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-15T22:56:05.716+0000 7fc84ec3e7c0 -1 osd.6 0 log_to_monitors true 2024-09-15T22:56:05.748 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-15T22:56:05.748+0000 7f85d62e27c0 -1 osd.5 0 log_to_monitors true 2024-09-15T22:56:05.768 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-15T22:56:05.770+0000 7fa6cc9ed7c0 -1 osd.1 0 log_to_monitors true 2024-09-15T22:56:05.798 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-15T22:56:05.798+0000 7f9cd06957c0 -1 osd.2 0 log_to_monitors true 2024-09-15T22:56:05.904 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-15T22:56:05.906+0000 7ff32c4607c0 -1 osd.3 0 log_to_monitors true 2024-09-15T22:56:05.911 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-15T22:56:05.912+0000 7f2b2f16d7c0 -1 osd.7 0 log_to_monitors true 2024-09-15T22:56:07.550 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:07.678 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 Processor -- start 2024-09-15T22:56:07.678 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 -- start start 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 0x7f0220071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 0x7f022015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02200727a0 con 0x7f022015d020 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0220072a80 con 0x7f022006ec40 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0228188640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0220072d60 con 0x7f0220145de0 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0226725640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f022015d020 0x7f02200ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43022/0 (socket says 172.21.15.28:43022) 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0226725640 1 -- 172.21.15.28:0/102103982 learned_addr learned my addr 172.21.15.28:0/102103982 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0225f24640 1 --2- 172.21.15.28:0/102103982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 0x7f0220071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.680 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0225723640 1 --2- 172.21.15.28:0/102103982 >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 0x7f022015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.677+0000 7f0224f22640 1 -- 172.21.15.28:0/102103982 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367722853 0 0) 0x7f02200727a0 con 0x7f022015d020 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0224f22640 1 -- 172.21.15.28:0/102103982 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f020c003530 con 0x7f022015d020 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225f24640 1 -- 172.21.15.28:0/102103982 >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 msgr2=0x7f022015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225f24640 1 --2- 172.21.15.28:0/102103982 >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 0x7f022015cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225f24640 1 -- 172.21.15.28:0/102103982 >> v1:172.21.15.28:6789/0 conn(0x7f022015d020 legacy=0x7f02200ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225f24640 1 -- 172.21.15.28:0/102103982 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220073040 con 0x7f0220145de0 2024-09-15T22:56:07.681 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225723640 1 --2- 172.21.15.28:0/102103982 >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 0x7f022015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:07.683 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0225f24640 1 --2- 172.21.15.28:0/102103982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 0x7f0220071f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f021c0097c0 tx=0x7f021c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c17019e047b0232 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:07.683 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0224f22640 1 -- 172.21.15.28:0/102103982 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0b5070 con 0x7f0220145de0 2024-09-15T22:56:07.683 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0224f22640 1 -- 172.21.15.28:0/102103982 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c0a8990 con 0x7f0220145de0 2024-09-15T22:56:07.683 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.681+0000 7f0224f22640 1 -- 172.21.15.28:0/102103982 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0a8d60 con 0x7f0220145de0 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- 172.21.15.28:0/102103982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 msgr2=0x7f0220071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- 172.21.15.28:0/102103982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 0x7f0220071f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f021c0097c0 tx=0x7f021c01ec90 comp rx=0 tx=0).stop 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- 172.21.15.28:0/102103982 shutdown_connections 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- 172.21.15.28:0/102103982 >> v2:172.21.15.131:3300/0 conn(0x7f022006ec40 0x7f022015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- 172.21.15.28:0/102103982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0220145de0 0x7f0220071f50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- 172.21.15.28:0/102103982 >> 172.21.15.28:0/102103982 conn(0x7f022006e150 msgr2=0x7f022006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:07.684 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- 172.21.15.28:0/102103982 shutdown_connections 2024-09-15T22:56:07.685 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- 172.21.15.28:0/102103982 wait complete. 2024-09-15T22:56:07.686 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 Processor -- start 2024-09-15T22:56:07.686 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- start start 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 0x7f022015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0220145de0 0x7f02201e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02201461c0 con 0x7f022015d020 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0220072490 con 0x7f0220145de0 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0228188640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f02200ce7c0 con 0x7f022006ec40 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37784/0 (socket says 172.21.15.28:37784) 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 -- 172.21.15.28:0/941627047 learned_addr learned my addr 172.21.15.28:0/941627047 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0225723640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0220145de0 0x7f02201e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.687 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0225f24640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 0x7f022015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.688 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 -- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 msgr2=0x7f022015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.688 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 0x7f022015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 -- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0220145de0 msgr2=0x7f02201e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0220145de0 0x7f02201e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 -- 172.21.15.28:0/941627047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02201415e0 con 0x7f022015d020 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0225f24640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 0x7f022015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.685+0000 7f0226725640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f021800caa0 tx=0x7f021800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218017070 con 0x7f022015d020 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f0228188640 1 -- 172.21.15.28:0/941627047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02201418c0 con 0x7f022015d020 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f0228188640 1 -- 172.21.15.28:0/941627047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02201f2a30 con 0x7f022015d020 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021800ac00 con 0x7f022015d020 2024-09-15T22:56:07.689 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218012400 con 0x7f022015d020 2024-09-15T22:56:07.690 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc0052a0 con 0x7f022015d020 2024-09-15T22:56:07.690 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f021801a070 con 0x7f022015d020 2024-09-15T22:56:07.690 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 0x7f0204069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:07.690 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f0218084aa0 con 0x7f022015d020 2024-09-15T22:56:07.691 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f0225f24640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 0x7f0204069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:07.691 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.689+0000 7f0225f24640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 0x7f0204069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f021c0b2000 tx=0x7f021c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:07.699 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.697+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0218055e90 con 0x7f022015d020 2024-09-15T22:56:07.967 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.965+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01fc005590 con 0x7f022015d020 2024-09-15T22:56:07.968 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.969+0000 7f02167fc640 1 -- 172.21.15.28:0/941627047 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f021805a190 con 0x7f022015d020 2024-09-15T22:56:07.968 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-15T22:56:07.968 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:07.129984+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:07.972 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 msgr2=0x7f0204069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.973 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 0x7f0204069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f021c0b2000 tx=0x7f021c008040 comp rx=0 tx=0).stop 2024-09-15T22:56:07.973 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 msgr2=0x7f02201e6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:07.973 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f021800caa0 tx=0x7f021800cf60 comp rx=0 tx=0).stop 2024-09-15T22:56:07.973 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 shutdown_connections 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f022015d020 0x7f02201e6630 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0204067830 0x7f0204069cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0220145de0 0x7f02201e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 --2- 172.21.15.28:0/941627047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f022006ec40 0x7f022015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 >> 172.21.15.28:0/941627047 conn(0x7f022006e150 msgr2=0x7f022006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 shutdown_connections 2024-09-15T22:56:07.974 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:07.973+0000 7f0203fff640 1 -- 172.21.15.28:0/941627047 wait complete. 2024-09-15T22:56:07.997 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:56:08.626 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-15T22:56:08.625+0000 7ff327be6640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:56:08.652 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-15T22:56:08.653+0000 7ff32022d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:08.724 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-15T22:56:08.725+0000 7fa43ebd1640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:56:08.725 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-15T22:56:08.725+0000 7fa6c8173640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:56:08.744 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-15T22:56:08.745+0000 7fa6c07ba640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:08.760 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-15T22:56:08.761+0000 7fa4361e3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:08.781 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-15T22:56:08.781+0000 7f9ccbe1b640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:56:08.800 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-15T22:56:08.801+0000 7f9cc4462640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:09.227 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-15T22:56:09.228+0000 7f2b2a8f3640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:56:09.250 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-15T22:56:09.252+0000 7eff9c7b5640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:56:09.253 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-15T22:56:09.252+0000 7f2b22f3a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:09.268 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-15T22:56:09.268+0000 7fc84b3f9640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:56:09.274 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-15T22:56:09.276+0000 7eff94dfc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:09.286 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-15T22:56:09.288+0000 7f85d2a9d640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:56:09.289 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-15T22:56:09.288+0000 7fc842a0b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:09.322 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-15T22:56:09.324+0000 7f85ca0af640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:56:14.793 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:56:14.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:56:14.804 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:14.997 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 Processor -- start 2024-09-15T22:56:14.997 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 -- start start 2024-09-15T22:56:14.998 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b30073a40 0x7f1b30073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:14.998 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 0x7f1b30071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:14.998 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b3015cd10 0x7f1b3015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:14.998 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1b30071a90 con 0x7f1b30073a40 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3015ff40 con 0x7f1b300710e0 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b35df2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1b30160200 con 0x7f1b3015cd10 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b30073a40 0x7f1b30073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b30073a40 0x7f1b30073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46846/0 (socket says 172.21.15.28:46846) 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 -- 172.21.15.28:0/1409457940 learned_addr learned my addr 172.21.15.28:0/1409457940 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2effd640 1 --2- 172.21.15.28:0/1409457940 >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 0x7f1b30071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 -- 172.21.15.28:0/1409457940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b3015cd10 msgr2=0x7f1b3015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/1409457940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b3015cd10 0x7f1b3015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 -- 172.21.15.28:0/1409457940 >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 msgr2=0x7f1b30071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:14.999 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/1409457940 >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 0x7f1b30071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.000 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2f7fe640 1 -- 172.21.15.28:0/1409457940 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b301604e0 con 0x7f1b30073a40 2024-09-15T22:56:15.000 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:14.997+0000 7f1b2effd640 1 --2- 172.21.15.28:0/1409457940 >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 0x7f1b30071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:15.001 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/1409457940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b30073a40 0x7f1b30073e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b300d01d0 tx=0x7f1b2001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6389f8e6e0419479 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.001 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2e7fc640 1 -- 172.21.15.28:0/1409457940 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b200b1070 con 0x7f1b30073a40 2024-09-15T22:56:15.001 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2e7fc640 1 -- 172.21.15.28:0/1409457940 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b200ac620 con 0x7f1b30073a40 2024-09-15T22:56:15.001 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2e7fc640 1 -- 172.21.15.28:0/1409457940 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b200ac9f0 con 0x7f1b30073a40 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- 172.21.15.28:0/1409457940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b30073a40 msgr2=0x7f1b30073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- 172.21.15.28:0/1409457940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b30073a40 0x7f1b30073e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b300d01d0 tx=0x7f1b2001c4f0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- 172.21.15.28:0/1409457940 shutdown_connections 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- 172.21.15.28:0/1409457940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b3015cd10 0x7f1b3015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- 172.21.15.28:0/1409457940 >> v2:172.21.15.131:3300/0 conn(0x7f1b300710e0 0x7f1b30071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- 172.21.15.28:0/1409457940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b30073a40 0x7f1b30073e20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- 172.21.15.28:0/1409457940 >> 172.21.15.28:0/1409457940 conn(0x7f1b3006bc70 msgr2=0x7f1b3006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- 172.21.15.28:0/1409457940 shutdown_connections 2024-09-15T22:56:15.002 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- 172.21.15.28:0/1409457940 wait complete. 2024-09-15T22:56:15.003 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 Processor -- start 2024-09-15T22:56:15.003 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- start start 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 0x7f1b3015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 0x7f1b30152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3013fb20 con 0x7f1b3015cd10 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3013f9a0 con 0x7f1b30073a40 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b35df2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3006d850 con 0x7f1b300710e0 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46850/0 (socket says 172.21.15.28:46850) 2024-09-15T22:56:15.005 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.001+0000 7f1b2ffff640 1 -- 172.21.15.28:0/2830371837 learned_addr learned my addr 172.21.15.28:0/2830371837 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 0x7f1b3015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2effd640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 0x7f1b30152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 -- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 msgr2=0x7f1b3015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 0x7f1b3015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 -- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 msgr2=0x7f1b30152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 0x7f1b30152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 -- 172.21.15.28:0/2830371837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b30152d40 con 0x7f1b3015cd10 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2effd640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 0x7f1b30152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 0x7f1b3015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2ffff640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b970 tx=0x7f1b2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28019070 con 0x7f1b3015cd10 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2800cb60 con 0x7f1b3015cd10 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3015df80 con 0x7f1b3015cd10 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28014440 con 0x7f1b3015cd10 2024-09-15T22:56:15.006 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3015e500 con 0x7f1b3015cd10 2024-09-15T22:56:15.007 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3006dbc0 con 0x7f1b3015cd10 2024-09-15T22:56:15.007 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b2801c070 con 0x7f1b3015cd10 2024-09-15T22:56:15.007 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 0x7f1b1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.008 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1b280857b0 con 0x7f1b3015cd10 2024-09-15T22:56:15.008 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 0x7f1b1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.008 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.005+0000 7f1b2f7fe640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 0x7f1b1c069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b200ae000 tx=0x7f1b200a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.011 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.009+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b30152d40 con 0x7f1b3015cd10 2024-09-15T22:56:15.177 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.177+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b300cdbd0 con 0x7f1b3015cd10 2024-09-15T22:56:15.179 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.177+0000 7f1b17fff640 1 -- 172.21.15.28:0/2830371837 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f1b28056510 con 0x7f1b3015cd10 2024-09-15T22:56:15.180 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-15T22:56:15.180 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":16,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:12.650732+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:15.182 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 msgr2=0x7f1b1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.182 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 0x7f1b1c069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b200ae000 tx=0x7f1b200a7000 comp rx=0 tx=0).stop 2024-09-15T22:56:15.182 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 msgr2=0x7f1b3015da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b970 tx=0x7f1b2800be30 comp rx=0 tx=0).stop 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 shutdown_connections 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b3015cd10 0x7f1b3015da40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1b1c0678c0 0x7f1b1c069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b30073a40 0x7f1b30152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 --2- 172.21.15.28:0/2830371837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b300710e0 0x7f1b3015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 >> 172.21.15.28:0/2830371837 conn(0x7f1b3006bc70 msgr2=0x7f1b300cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 shutdown_connections 2024-09-15T22:56:15.183 INFO:teuthology.misc.health.smithi028.stderr:2024-09-15T22:56:15.181+0000 7f1b35df2640 1 -- 172.21.15.28:0/2830371837 wait complete. 2024-09-15T22:56:15.198 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T22:56:15.198 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T22:56:15.198 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:56:15.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:56:15.200 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:56:15.201 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:56:15.201 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:56:15.202 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:56:15.202 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:56:15.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:56:15.205 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:56:15.205 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:56:15.205 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:56:15.207 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:56:15.208 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T22:56:15.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:15.282 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2024-09-15T22:56:15.283 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2024-09-15T22:56:15.293 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-15T22:56:15.293 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-15T22:56:15.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 Processor -- start 2024-09-15T22:56:15.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 -- start start 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f71f00aefc0 0x7f71f01690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00b56d0 con 0x7f71f00b5160 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00cf650 con 0x7f71f015e3a0 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71f61ee640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f71f00d0840 con 0x7f71f00aefc0 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71eeffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f71f00b5160 0x7f71f00ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55366/0 (socket says 172.21.15.28:55366) 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71eeffd640 1 -- 172.21.15.28:0/644029201 learned_addr learned my addr 172.21.15.28:0/644029201 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71effff640 1 --2- 172.21.15.28:0/644029201 >> v2:172.21.15.28:3300/0 conn(0x7f71f00aefc0 0x7f71f01690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71ee7fc640 1 -- 172.21.15.28:0/644029201 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194533383 0 0) 0x7f71f00b56d0 con 0x7f71f00b5160 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71ee7fc640 1 -- 172.21.15.28:0/644029201 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d8003530 con 0x7f71f00b5160 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71effff640 1 -- 172.21.15.28:0/644029201 >> v1:172.21.15.131:6789/0 conn(0x7f71f015e3a0 legacy=0x7f71f00d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71effff640 1 -- 172.21.15.28:0/644029201 >> v1:172.21.15.28:6789/0 conn(0x7f71f00b5160 legacy=0x7f71f00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.321+0000 7f71effff640 1 -- 172.21.15.28:0/644029201 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f00cf930 con 0x7f71f00aefc0 2024-09-15T22:56:15.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71effff640 1 --2- 172.21.15.28:0/644029201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00aefc0 0x7f71f01690a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6ce3bbc406df75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71ee7fc640 1 -- 172.21.15.28:0/644029201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80b2070 con 0x7f71f00aefc0 2024-09-15T22:56:15.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71ee7fc640 1 -- 172.21.15.28:0/644029201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e80a5990 con 0x7f71f00aefc0 2024-09-15T22:56:15.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71ee7fc640 1 -- 172.21.15.28:0/644029201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80a5d60 con 0x7f71f00aefc0 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- 172.21.15.28:0/644029201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00aefc0 msgr2=0x7f71f01690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 --2- 172.21.15.28:0/644029201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00aefc0 0x7f71f01690a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e801c8b0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- 172.21.15.28:0/644029201 shutdown_connections 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 --2- 172.21.15.28:0/644029201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00aefc0 0x7f71f01690a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- 172.21.15.28:0/644029201 >> 172.21.15.28:0/644029201 conn(0x7f71f00b0740 msgr2=0x7f71f00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- 172.21.15.28:0/644029201 shutdown_connections 2024-09-15T22:56:15.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- 172.21.15.28:0/644029201 wait complete. 2024-09-15T22:56:15.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 Processor -- start 2024-09-15T22:56:15.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.325+0000 7f71f61ee640 1 -- start start 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71f00aefc0 0x7f71f0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 0x7f71f006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00cf430 con 0x7f71f00b5160 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00cf2b0 con 0x7f71f00aefc0 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f71f016be00 con 0x7f71f015e3a0 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46904/0 (socket says 172.21.15.28:46904) 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71eeffd640 1 -- 172.21.15.28:0/2987113000 learned_addr learned my addr 172.21.15.28:0/2987113000 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 0x7f71f006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71ef7fe640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71f00aefc0 0x7f71f0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 -- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71f00aefc0 msgr2=0x7f71f0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71f00aefc0 0x7f71f0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 -- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 msgr2=0x7f71f01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 -- 172.21.15.28:0/2987113000 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f006bdf0 con 0x7f71f015e3a0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71eeffd640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71effff640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 0x7f71f006cbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71e80ac000 tx=0x7f71e8019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80b2050 con 0x7f71f015e3a0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e80be070 con 0x7f71f015e3a0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f006c0d0 con 0x7f71f015e3a0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80ada70 con 0x7f71f015e3a0 2024-09-15T22:56:15.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f006c690 con 0x7f71f015e3a0 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f00ae8b0 con 0x7f71f015e3a0 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71e80adc10 con 0x7f71f015e3a0 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 0x7f71dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f71e8120990 con 0x7f71f015e3a0 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.329+0000 7f71ef7fe640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 0x7f71dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:15.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.333+0000 7f71ef7fe640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 0x7f71dc069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71e0001770 tx=0x7f71e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:15.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.337+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71e8016560 con 0x7f71f015e3a0 2024-09-15T22:56:15.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.533+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71f015a480 con 0x7f71f015e3a0 2024-09-15T22:56:15.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71d7fff640 1 -- 172.21.15.28:0/2987113000 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f71e80f1260 con 0x7f71f015e3a0 2024-09-15T22:56:15.536 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:15.537 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"btime":"2024-09-15T22:56:15:290035+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:56:15.537 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 msgr2=0x7f71dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 0x7f71dc069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71e0001770 tx=0x7f71e0009040 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 msgr2=0x7f71f006cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 0x7f71f006cbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71e80ac000 tx=0x7f71e8019650 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 shutdown_connections 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71f015e3a0 0x7f71f006cbb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71f00b5160 0x7f71f01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71dc0678f0 0x7f71dc069db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 --2- 172.21.15.28:0/2987113000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71f00aefc0 0x7f71f0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 >> 172.21.15.28:0/2987113000 conn(0x7f71f00b0740 msgr2=0x7f71f0156230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:15.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 shutdown_connections 2024-09-15T22:56:15.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:15.537+0000 7f71f61ee640 1 -- 172.21.15.28:0/2987113000 wait complete. 2024-09-15T22:56:17.556 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.689+0000 7faed3e20640 1 Processor -- start 2024-09-15T22:56:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.689+0000 7faed3e20640 1 -- start start 2024-09-15T22:56:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed3e20640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc06d870 0x7faecc06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed3e20640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faecc0b3610 0x7faecc0d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed3e20640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc06e190 con 0x7faecc15e820 2024-09-15T22:56:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed3e20640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7faecc0d2ba0 con 0x7faecc0b3610 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed3e20640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0d2e80 con 0x7faecc06d870 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faecc0b3610 0x7faecc0d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faecc0b3610 0x7faecc0d3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46912/0 (socket says 172.21.15.28:46912) 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 -- 172.21.15.28:0/308268072 learned_addr learned my addr 172.21.15.28:0/308268072 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 -- 172.21.15.28:0/308268072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc06d870 msgr2=0x7faecc06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 --2- 172.21.15.28:0/308268072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc06d870 0x7faecc06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 -- 172.21.15.28:0/308268072 >> v1:172.21.15.131:6789/0 conn(0x7faecc15e820 legacy=0x7faecc0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:17.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 -- 172.21.15.28:0/308268072 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc0d3160 con 0x7faecc0b3610 2024-09-15T22:56:17.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed23bd640 1 --2- 172.21.15.28:0/308268072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc0b3610 0x7faecc0d3c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faebc009870 tx=0x7faebc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda5d2e32cdd3694 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:17.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed0bba640 1 -- 172.21.15.28:0/308268072 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0aa610 con 0x7faecc0b3610 2024-09-15T22:56:17.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed0bba640 1 -- 172.21.15.28:0/308268072 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc0af070 con 0x7faecc0b3610 2024-09-15T22:56:17.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.693+0000 7faed0bba640 1 -- 172.21.15.28:0/308268072 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0aa9d0 con 0x7faecc0b3610 2024-09-15T22:56:17.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/308268072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc0b3610 msgr2=0x7faecc0d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- 172.21.15.28:0/308268072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc0b3610 0x7faecc0d3c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faebc009870 tx=0x7faebc01c4f0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/308268072 shutdown_connections 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- 172.21.15.28:0/308268072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc0b3610 0x7faecc0d3c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- 172.21.15.28:0/308268072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc06d870 0x7faecc06dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/308268072 >> 172.21.15.28:0/308268072 conn(0x7faecc0d4910 msgr2=0x7faecc0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/308268072 shutdown_connections 2024-09-15T22:56:17.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/308268072 wait complete. 2024-09-15T22:56:17.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 Processor -- start 2024-09-15T22:56:17.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- start start 2024-09-15T22:56:17.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faecc0b3610 0x7faecc0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc15e820 0x7faecc15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faecc16b530 con 0x7faecc06d870 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faecc16b3b0 con 0x7faecc0b3610 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faecc16b6b0 con 0x7faecc15e820 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46920/0 (socket says 172.21.15.28:46920) 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 -- 172.21.15.28:0/1380991660 learned_addr learned my addr 172.21.15.28:0/1380991660 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 -- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc15e820 msgr2=0x7faecc15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc15e820 0x7faecc15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 -- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faecc0b3610 msgr2=0x7faecc0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faecc0b3610 0x7faecc0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 -- 172.21.15.28:0/1380991660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc0d2720 con 0x7faecc06d870 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed1bbc640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faec400ba50 tx=0x7faec400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:17.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4019070 con 0x7faecc06d870 2024-09-15T22:56:17.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec400cc00 con 0x7faecc06d870 2024-09-15T22:56:17.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc168f60 con 0x7faecc06d870 2024-09-15T22:56:17.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4014440 con 0x7faecc06d870 2024-09-15T22:56:17.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.697+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc168c80 con 0x7faecc06d870 2024-09-15T22:56:17.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc06dc50 con 0x7faecc06d870 2024-09-15T22:56:17.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faec401c070 con 0x7faecc06d870 2024-09-15T22:56:17.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faeca7fc640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 0x7faeb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:17.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7faec40856f0 con 0x7faecc06d870 2024-09-15T22:56:17.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faed13bb640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 0x7faeb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:17.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.701+0000 7faed13bb640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 0x7faeb8069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc0ca080 tx=0x7faec0006bd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:17.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.705+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faec4056580 con 0x7faecc06d870 2024-09-15T22:56:17.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.905+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faecc0d3f40 con 0x7faecc06d870 2024-09-15T22:56:17.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.905+0000 7faeca7fc640 1 -- 172.21.15.28:0/1380991660 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7faec4055e80 con 0x7faecc06d870 2024-09-15T22:56:17.907 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:17.907 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"btime":"2024-09-15T22:56:16:291217+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:56:17.908 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2024-09-15T22:56:17.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 msgr2=0x7faeb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:17.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 0x7faeb8069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc0ca080 tx=0x7faec0006bd0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 msgr2=0x7faecc1683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faec400ba50 tx=0x7faec400bf10 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 shutdown_connections 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faecc15e820 0x7faecc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faeb80678c0 0x7faeb8069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faecc0b3610 0x7faecc0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 --2- 172.21.15.28:0/1380991660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc06d870 0x7faecc1683c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 >> 172.21.15.28:0/1380991660 conn(0x7faecc0d4910 msgr2=0x7faecc160c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 shutdown_connections 2024-09-15T22:56:17.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:17.909+0000 7faed3e20640 1 -- 172.21.15.28:0/1380991660 wait complete. 2024-09-15T22:56:17.927 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:56:18.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 Processor -- start 2024-09-15T22:56:18.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 -- start start 2024-09-15T22:56:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f56140b4710 0x7f56140b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140b4bd0 con 0x7f56140ce210 2024-09-15T22:56:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140b4eb0 con 0x7f56140cde30 2024-09-15T22:56:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5618c55640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f561415f260 con 0x7f56140b4710 2024-09-15T22:56:18.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5612d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f56140ce210 0x7f561415e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55368/0 (socket says 172.21.15.28:55368) 2024-09-15T22:56:18.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5612d9d640 1 -- 172.21.15.28:0/1740225512 learned_addr learned my addr 172.21.15.28:0/1740225512 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 --2- 172.21.15.28:0/1740225512 >> v2:172.21.15.131:3300/0 conn(0x7f56140b4710 0x7f56140b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579099752 0 0) 0x7f56140b4bd0 con 0x7f56140ce210 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5600004640 con 0x7f56140ce210 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 303931508 0 0) 0x7f5600004640 con 0x7f56140ce210 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 >> v2:172.21.15.131:3300/0 conn(0x7f56140b4710 msgr2=0x7f56140b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 --2- 172.21.15.28:0/1740225512 >> v2:172.21.15.131:3300/0 conn(0x7f56140b4710 0x7f56140b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 >> v1:172.21.15.131:6789/0 conn(0x7f56140cde30 legacy=0x7f56140ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140b5190 con 0x7f56140ce210 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f560c001680 con 0x7f56140ce210 2024-09-15T22:56:18.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 >> v1:172.21.15.28:6789/0 conn(0x7f56140ce210 legacy=0x7f561415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5600004ad0 0x7f5600004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 0x7f5600005da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56000062e0 0x7f560000cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f560000d250 con 0x7f5600005920 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f560000d400 con 0x7f56000062e0 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f560000d600 con 0x7f5600004ad0 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 0x7f5600005da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f561259c640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5600004ad0 0x7f5600004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 -- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5600004ad0 msgr2=0x7f5600004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5600004ad0 0x7f5600004ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 -- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56000062e0 msgr2=0x7f560000cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56000062e0 0x7f560000cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f560bfff640 1 -- 172.21.15.28:0/1740225512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5600004640 con 0x7f5600005920 2024-09-15T22:56:18.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.045+0000 7f5612d9d640 1 -- 172.21.15.28:0/1740225512 reap_dead start 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f560bfff640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 0x7f5600005da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009a90 tx=0x7f55fc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b7f8a17f68dd2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b2070 con 0x7f5600005920 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc0a5570 con 0x7f5600005920 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5611d9b640 1 -- 172.21.15.28:0/1740225512 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc009690 con 0x7f5600005920 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 msgr2=0x7f5600005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 0x7f5600005da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009a90 tx=0x7f55fc01ca00 comp rx=0 tx=0).stop 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- 172.21.15.28:0/1740225512 shutdown_connections 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 --2- 172.21.15.28:0/1740225512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5600005920 0x7f5600005da0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- 172.21.15.28:0/1740225512 >> 172.21.15.28:0/1740225512 conn(0x7f561406bcc0 msgr2=0x7f561406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- 172.21.15.28:0/1740225512 shutdown_connections 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- 172.21.15.28:0/1740225512 wait complete. 2024-09-15T22:56:18.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 Processor -- start 2024-09-15T22:56:18.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- start start 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 0x7f5614156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56140aeb10 0x7f5614157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56140cd4b0 con 0x7f56140aef90 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56140cd330 con 0x7f5600005920 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5618c55640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f561415e3e0 con 0x7f56140aeb10 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5612d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5612d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46938/0 (socket says 172.21.15.28:46938) 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f5612d9d640 1 -- 172.21.15.28:0/232577100 learned_addr learned my addr 172.21.15.28:0/232577100 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:18.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f561259c640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 0x7f5614156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.049+0000 7f560bfff640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56140aeb10 0x7f5614157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 -- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56140aeb10 msgr2=0x7f5614157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56140aeb10 0x7f5614157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 -- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 msgr2=0x7f5614156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 0x7f5614156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 -- 172.21.15.28:0/232577100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56141587b0 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f561259c640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 0x7f5614156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5612d9d640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56140cef10 tx=0x7f560c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c004c00 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c004dc0 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c007270 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5614156430 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56141569f0 con 0x7f56140aef90 2024-09-15T22:56:18.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561415e770 con 0x7f56140aef90 2024-09-15T22:56:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f560c007410 con 0x7f56140aef90 2024-09-15T22:56:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 0x7f55f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f560c084270 con 0x7f56140aef90 2024-09-15T22:56:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f561259c640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 0x7f55f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.053+0000 7f561259c640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 0x7f55f4069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5604007fd0 tx=0x7f5604009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.057+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f560c019070 con 0x7f56140aef90 2024-09-15T22:56:18.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.217+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f561415cec0 con 0x7f56140aef90 2024-09-15T22:56:18.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.217+0000 7f560affd640 1 -- 172.21.15.28:0/232577100 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f560c055190 con 0x7f56140aef90 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:56:18.220 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 msgr2=0x7f55f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 0x7f55f4069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5604007fd0 tx=0x7f5604009040 comp rx=0 tx=0).stop 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 msgr2=0x7f5614158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56140cef10 tx=0x7f560c00c890 comp rx=0 tx=0).stop 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 shutdown_connections 2024-09-15T22:56:18.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56140aef90 0x7f5614158110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56140aeb10 0x7f5614157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55f40678c0 0x7f55f4069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 --2- 172.21.15.28:0/232577100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5600005920 0x7f5614156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 >> 172.21.15.28:0/232577100 conn(0x7f561406bcc0 msgr2=0x7f561415d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 shutdown_connections 2024-09-15T22:56:18.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.221+0000 7f5618c55640 1 -- 172.21.15.28:0/232577100 wait complete. 2024-09-15T22:56:18.237 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:56:18.237 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:56:18.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.361+0000 7f89a7f29640 1 Processor -- start 2024-09-15T22:56:18.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.361+0000 7f89a7f29640 1 -- start start 2024-09-15T22:56:18.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a7f29640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89a015a060 0x7f89a00cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a7f29640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00cccf0 con 0x7f89a00cf930 2024-09-15T22:56:18.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a7f29640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a00ccfd0 con 0x7f89a015c9a0 2024-09-15T22:56:18.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a7f29640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f89a015a440 con 0x7f89a015a060 2024-09-15T22:56:18.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a64c6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f89a00cf930 0x7f89a015ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55372/0 (socket says 172.21.15.28:55372) 2024-09-15T22:56:18.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a64c6640 1 -- 172.21.15.28:0/2227498639 learned_addr learned my addr 172.21.15.28:0/2227498639 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:18.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a5cc5640 1 --2- 172.21.15.28:0/2227498639 >> v2:172.21.15.28:3300/0 conn(0x7f89a015a060 0x7f89a00cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617857741 0 0) 0x7f89a00cccf0 con 0x7f89a00cf930 2024-09-15T22:56:18.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003530 con 0x7f89a00cf930 2024-09-15T22:56:18.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a5cc5640 1 -- 172.21.15.28:0/2227498639 >> v1:172.21.15.131:6789/0 conn(0x7f89a015c9a0 legacy=0x7f89a00cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a5cc5640 1 -- 172.21.15.28:0/2227498639 >> v1:172.21.15.28:6789/0 conn(0x7f89a00cf930 legacy=0x7f89a015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1341750774 0 0) 0x7f898c003530 con 0x7f89a00cf930 2024-09-15T22:56:18.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a5cc5640 1 -- 172.21.15.28:0/2227498639 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a00cd2b0 con 0x7f89a015a060 2024-09-15T22:56:18.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a5cc5640 1 --2- 172.21.15.28:0/2227498639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015a060 0x7f89a00cff90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dc9938742df4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998001680 con 0x7f89a015a060 2024-09-15T22:56:18.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c0a64e0 con 0x7f89a015a060 2024-09-15T22:56:18.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.365+0000 7f89a4cc3640 1 -- 172.21.15.28:0/2227498639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c0a6890 con 0x7f89a015a060 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/2227498639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015a060 msgr2=0x7f89a00cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 --2- 172.21.15.28:0/2227498639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015a060 0x7f89a00cff90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c01c890 comp rx=0 tx=0).stop 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/2227498639 shutdown_connections 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 --2- 172.21.15.28:0/2227498639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015a060 0x7f89a00cff90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/2227498639 >> 172.21.15.28:0/2227498639 conn(0x7f89a006bcc0 msgr2=0x7f89a006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/2227498639 shutdown_connections 2024-09-15T22:56:18.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/2227498639 wait complete. 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 Processor -- start 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- start start 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89a00cf930 0x7f89a0166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 0x7f89a0153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f89a016a480 con 0x7f89a015c9a0 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f89a016a300 con 0x7f89a00cf930 2024-09-15T22:56:18.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f89a016a600 con 0x7f89a015a060 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46950/0 (socket says 172.21.15.28:46950) 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 -- 172.21.15.28:0/3218937249 learned_addr learned my addr 172.21.15.28:0/3218937249 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a5cc5640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89a00cf930 0x7f89a0166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a54c4640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 0x7f89a0153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 -- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 msgr2=0x7f89a0153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 0x7f89a0153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 -- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89a00cf930 msgr2=0x7f89a0166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89a00cf930 0x7f89a0166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 -- 172.21.15.28:0/3218937249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a01554f0 con 0x7f89a015c9a0 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a54c4640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 0x7f89a0153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a64c6640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f899800c750 tx=0x7f899800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998005ae0 con 0x7f89a015c9a0 2024-09-15T22:56:18.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998005ca0 con 0x7f89a015c9a0 2024-09-15T22:56:18.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980072b0 con 0x7f89a015c9a0 2024-09-15T22:56:18.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a00b4720 con 0x7f89a015c9a0 2024-09-15T22:56:18.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.369+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a00b4ce0 con 0x7f89a015c9a0 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a0069220 con 0x7f89a015c9a0 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8998007450 con 0x7f89a015c9a0 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89967fc640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 0x7f8984069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8998085880 con 0x7f89a015c9a0 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89a5cc5640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 0x7f8984069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:18.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.373+0000 7f89a5cc5640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 0x7f8984069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899c0af000 tx=0x7f899c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:18.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.377+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8998010300 con 0x7f89a015c9a0 2024-09-15T22:56:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.541+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f89a00b4ee0 con 0x7f89a015c9a0 2024-09-15T22:56:18.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.969+0000 7f89967fc640 1 -- 172.21.15.28:0/3218937249 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f89a00b4ee0 con 0x7f89a015c9a0 2024-09-15T22:56:18.971 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-09-15T22:56:18.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 msgr2=0x7f8984069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 0x7f8984069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899c0af000 tx=0x7f899c0a7000 comp rx=0 tx=0).stop 2024-09-15T22:56:18.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 msgr2=0x7f89a0157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:18.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f899800c750 tx=0x7f899800cc10 comp rx=0 tx=0).stop 2024-09-15T22:56:18.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 shutdown_connections 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89a015c9a0 0x7f89a0157bc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89a015a060 0x7f89a0153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f89840678c0 0x7f8984069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 --2- 172.21.15.28:0/3218937249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89a00cf930 0x7f89a0166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 >> 172.21.15.28:0/3218937249 conn(0x7f89a006bcc0 msgr2=0x7f89a015db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 shutdown_connections 2024-09-15T22:56:18.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:18.973+0000 7f89a7f29640 1 -- 172.21.15.28:0/3218937249 wait complete. 2024-09-15T22:56:19.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:56:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 Processor -- start 2024-09-15T22:56:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 -- start start 2024-09-15T22:56:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1a94145bb0 0x7f1a9415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1a940b31a0 0x7f1a940732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b1e30 0x7f1a940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1a940b3d40 con 0x7f1a94145bb0 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1a940b27b0 con 0x7f1a940b31a0 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a99b27640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1a94145f90 con 0x7f1a940b1e30 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1a94145bb0 0x7f1a9415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1a94145bb0 0x7f1a9415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46952/0 (socket says 172.21.15.28:46952) 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 -- 172.21.15.28:0/92781209 learned_addr learned my addr 172.21.15.28:0/92781209 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a93fff640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b1e30 0x7f1a940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a92ffd640 1 --2- 172.21.15.28:0/92781209 >> v2:172.21.15.131:3300/0 conn(0x7f1a940b31a0 0x7f1a940732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 -- 172.21.15.28:0/92781209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b1e30 msgr2=0x7f1a940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b1e30 0x7f1a940b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 -- 172.21.15.28:0/92781209 >> v2:172.21.15.131:3300/0 conn(0x7f1a940b31a0 msgr2=0x7f1a940732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 --2- 172.21.15.28:0/92781209 >> v2:172.21.15.131:3300/0 conn(0x7f1a940b31a0 0x7f1a940732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.129+0000 7f1a937fe640 1 -- 172.21.15.28:0/92781209 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a94073b40 con 0x7f1a94145bb0 2024-09-15T22:56:19.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a937fe640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a94145bb0 0x7f1a9415c7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a940af830 tx=0x7f1a8401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ad75ab735b1be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:19.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a927fc640 1 -- 172.21.15.28:0/92781209 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840b0070 con 0x7f1a94145bb0 2024-09-15T22:56:19.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a927fc640 1 -- 172.21.15.28:0/92781209 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a840ab600 con 0x7f1a94145bb0 2024-09-15T22:56:19.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a927fc640 1 -- 172.21.15.28:0/92781209 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840ab9d0 con 0x7f1a94145bb0 2024-09-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- 172.21.15.28:0/92781209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a94145bb0 msgr2=0x7f1a9415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a94145bb0 0x7f1a9415c7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a940af830 tx=0x7f1a8401c520 comp rx=0 tx=0).stop 2024-09-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- 172.21.15.28:0/92781209 shutdown_connections 2024-09-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b1e30 0x7f1a940b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 --2- 172.21.15.28:0/92781209 >> v2:172.21.15.131:3300/0 conn(0x7f1a940b31a0 0x7f1a940732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 --2- 172.21.15.28:0/92781209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a94145bb0 0x7f1a9415c7f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- 172.21.15.28:0/92781209 >> 172.21.15.28:0/92781209 conn(0x7f1a94067e30 msgr2=0x7f1a9406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- 172.21.15.28:0/92781209 shutdown_connections 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- 172.21.15.28:0/92781209 wait complete. 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 Processor -- start 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.133+0000 7f1a99b27640 1 -- start start 2024-09-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b31a0 0x7f1a9415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a94145bb0 0x7f1a9415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a940b49e0 con 0x7f1a940b1e30 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94073810 con 0x7f1a94145bb0 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1a940b4b60 con 0x7f1a940b31a0 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46962/0 (socket says 172.21.15.28:46962) 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 -- 172.21.15.28:0/3359704657 learned_addr learned my addr 172.21.15.28:0/3359704657 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a92ffd640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b31a0 0x7f1a9415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a93fff640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a94145bb0 0x7f1a9415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 -- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b31a0 msgr2=0x7f1a9415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b31a0 0x7f1a9415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 -- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a94145bb0 msgr2=0x7f1a9415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a94145bb0 0x7f1a9415ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 -- 172.21.15.28:0/3359704657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9413ab80 con 0x7f1a940b1e30 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a937fe640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a840ae040 tx=0x7f1a8401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840b0040 con 0x7f1a940b1e30 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a840bc070 con 0x7f1a940b1e30 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9413ae60 con 0x7f1a940b1e30 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840b6640 con 0x7f1a940b1e30 2024-09-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9413b420 con 0x7f1a940b1e30 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a940732d0 con 0x7f1a940b1e30 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a840b67e0 con 0x7f1a940b1e30 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 0x7f1a74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.137+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f1a8411fe30 con 0x7f1a940b1e30 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.141+0000 7f1a92ffd640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 0x7f1a74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:19.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.141+0000 7f1a92ffd640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 0x7f1a74069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a94071b30 tx=0x7f1a7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:19.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.145+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a84016110 con 0x7f1a940b1e30 2024-09-15T22:56:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.301+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1a940b0890 con 0x7f1a940b1e30 2024-09-15T22:56:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.973+0000 7f1a8bfff640 1 -- 172.21.15.28:0/3359704657 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f1a840f0b50 con 0x7f1a940b1e30 2024-09-15T22:56:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 msgr2=0x7f1a74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 0x7f1a74069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a94071b30 tx=0x7f1a7c008040 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 msgr2=0x7f1a9413a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a840ae040 tx=0x7f1a8401ad60 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 shutdown_connections 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1a740678c0 0x7f1a74069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a94145bb0 0x7f1a9415ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a940b31a0 0x7f1a9415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 --2- 172.21.15.28:0/3359704657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a940b1e30 0x7f1a9413a3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.977+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 >> 172.21.15.28:0/3359704657 conn(0x7f1a94067e30 msgr2=0x7f1a940b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:19.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.981+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 shutdown_connections 2024-09-15T22:56:19.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:19.981+0000 7f1a99b27640 1 -- 172.21.15.28:0/3359704657 wait complete. 2024-09-15T22:56:20.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:56:20.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.137+0000 7fe87e5ba640 1 Processor -- start 2024-09-15T22:56:20.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.137+0000 7fe87e5ba640 1 -- start start 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87e5ba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe878145b20 0x7fe878072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87e5ba640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe878073a40 con 0x7fe8780b2540 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87e5ba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe878072ec0 con 0x7fe878072860 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87e5ba640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe8780731a0 con 0x7fe878145b20 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87cb57640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe8780b2540 0x7fe8780cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55380/0 (socket says 172.21.15.28:55380) 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87cb57640 1 -- 172.21.15.28:0/3437582168 learned_addr learned my addr 172.21.15.28:0/3437582168 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:20.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 --2- 172.21.15.28:0/3437582168 >> v2:172.21.15.131:3300/0 conn(0x7fe878145b20 0x7fe878072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837604586 0 0) 0x7fe878073a40 con 0x7fe8780b2540 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe860003530 con 0x7fe8780b2540 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2193762915 0 0) 0x7fe860003530 con 0x7fe8780b2540 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 >> v2:172.21.15.131:3300/0 conn(0x7fe878145b20 msgr2=0x7fe878072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 --2- 172.21.15.28:0/3437582168 >> v2:172.21.15.131:3300/0 conn(0x7fe878145b20 0x7fe878072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 >> v1:172.21.15.131:6789/0 conn(0x7fe878072860 legacy=0x7fe8780b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe878073480 con 0x7fe8780b2540 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fe870001a20 con 0x7fe8780b2540 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 >> v1:172.21.15.28:6789/0 conn(0x7fe8780b2540 legacy=0x7fe8780cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe860003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe860004810 0x7fe860004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8600051d0 0x7fe86000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780731a0 con 0x7fe8600039c0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe86000c170 con 0x7fe8600051d0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe86000c370 con 0x7fe860004810 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe860003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe8777fe640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe860004810 0x7fe860004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 -- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe860004810 msgr2=0x7fe860004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe860004810 0x7fe860004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87cb57640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8600051d0 0x7fe86000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 -- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8600051d0 msgr2=0x7fe86000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8600051d0 0x7fe86000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe877fff640 1 -- 172.21.15.28:0/3437582168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860003530 con 0x7fe8600039c0 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87cb57640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8600051d0 0x7fe86000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:20.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.141+0000 7fe87cb57640 1 -- 172.21.15.28:0/3437582168 reap_dead start 2024-09-15T22:56:20.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe860003de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe868009ae0 tx=0x7fe86801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae78dc0047b0668 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680096b0 con 0x7fe8600039c0 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8680a6450 con 0x7fe8600039c0 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe876ffd640 1 -- 172.21.15.28:0/3437582168 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a6840 con 0x7fe8600039c0 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 msgr2=0x7fe860003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe860003de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe868009ae0 tx=0x7fe86801ca70 comp rx=0 tx=0).stop 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- 172.21.15.28:0/3437582168 shutdown_connections 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/3437582168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe860003de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- 172.21.15.28:0/3437582168 >> 172.21.15.28:0/3437582168 conn(0x7fe87806bcc0 msgr2=0x7fe87806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- 172.21.15.28:0/3437582168 shutdown_connections 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- 172.21.15.28:0/3437582168 wait complete. 2024-09-15T22:56:20.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 Processor -- start 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- start start 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8781ec4f0 0x7fe8781ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8780ae8b0 0x7fe8780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe878146080 con 0x7fe8600039c0 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe878145f00 con 0x7fe8780ae8b0 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87e5ba640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe8781607a0 con 0x7fe8781ec4f0 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46976/0 (socket says 172.21.15.28:46976) 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 -- 172.21.15.28:0/2913544482 learned_addr learned my addr 172.21.15.28:0/2913544482 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:20.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe8777fe640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8781ec4f0 0x7fe8781ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe87cb57640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8780ae8b0 0x7fe8780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 -- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8781ec4f0 msgr2=0x7fe8781ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8781ec4f0 0x7fe8781ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 -- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8780ae8b0 msgr2=0x7fe8780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8780ae8b0 0x7fe8780aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 -- 172.21.15.28:0/2913544482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8781eaa60 con 0x7fe8600039c0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe877fff640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe868009ae0 tx=0x7fe868019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.145+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a6c80 con 0x7fe8600039c0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8680a6e20 con 0x7fe8600039c0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680b9660 con 0x7fe8600039c0 2024-09-15T22:56:20.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781ead40 con 0x7fe8600039c0 2024-09-15T22:56:20.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8781ea750 con 0x7fe8600039c0 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe878069220 con 0x7fe8600039c0 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8680c2440 con 0x7fe8600039c0 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe874ff9640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 0x7fe864069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fe86811fdc0 con 0x7fe8600039c0 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe8777fe640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 0x7fe864069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:20.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.149+0000 7fe8777fe640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 0x7fe864069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8780b0ae0 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:20.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.153+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8680ac020 con 0x7fe8600039c0 2024-09-15T22:56:20.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:20.353+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe878160aa0 con 0x7fe8600039c0 2024-09-15T22:56:21.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.029+0000 7fe874ff9640 1 -- 172.21.15.28:0/2913544482 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe868016780 con 0x7fe8600039c0 2024-09-15T22:56:21.033 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:56:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 msgr2=0x7fe864069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 0x7fe864069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8780b0ae0 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2024-09-15T22:56:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 msgr2=0x7fe87815bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe868009ae0 tx=0x7fe868019810 comp rx=0 tx=0).stop 2024-09-15T22:56:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 shutdown_connections 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8640678f0 0x7fe864069db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8780ae8b0 0x7fe8780aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8781ec4f0 0x7fe8781ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 --2- 172.21.15.28:0/2913544482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8600039c0 0x7fe87815bcc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 >> 172.21.15.28:0/2913544482 conn(0x7fe87806bcc0 msgr2=0x7fe8780cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 shutdown_connections 2024-09-15T22:56:21.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.041+0000 7fe87e5ba640 1 -- 172.21.15.28:0/2913544482 wait complete. 2024-09-15T22:56:21.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:21.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 Processor -- start 2024-09-15T22:56:21.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 -- start start 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f502c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c15e9b0 con 0x7f502c15e5d0 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c0aee30 con 0x7f502c0af5f0 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f5031f6e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f502c06c640 con 0x7f502c06bcc0 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f502c15e5d0 0x7f502c0cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55390/0 (socket says 172.21.15.28:55390) 2024-09-15T22:56:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502b7fe640 1 -- 172.21.15.28:0/222777433 learned_addr learned my addr 172.21.15.28:0/222777433 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656649241 0 0) 0x7f502c15e9b0 con 0x7f502c15e5d0 2024-09-15T22:56:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502affd640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f502c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5014003530 con 0x7f502c15e5d0 2024-09-15T22:56:21.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1283183146 0 0) 0x7f5014003530 con 0x7f502c15e5d0 2024-09-15T22:56:21.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 msgr2=0x7f502c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f502c06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 >> v1:172.21.15.131:6789/0 conn(0x7f502c0af5f0 legacy=0x7f502c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c0700c0 con 0x7f502c15e5d0 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f501c001680 con 0x7f502c15e5d0 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 >> v1:172.21.15.28:6789/0 conn(0x7f502c15e5d0 legacy=0x7f502c0cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50140039f0 0x7f5014003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f5014004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5014004d50 0x7f50140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f502c06c640 con 0x7f5014004d50 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f501400bab0 con 0x7f50140039f0 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f501400bcb0 con 0x7f502c06bcc0 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5014004d50 0x7f50140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502b7fe640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50140039f0 0x7f5014003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502affd640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f5014004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 -- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 msgr2=0x7f5014004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f5014004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 -- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50140039f0 msgr2=0x7f5014003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50140039f0 0x7f5014003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502bfff640 1 -- 172.21.15.28:0/222777433 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5014003530 con 0x7f5014004d50 2024-09-15T22:56:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.193+0000 7f502affd640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c06bcc0 0x7f5014004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f502bfff640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5014004d50 0x7f50140051d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5024001e40 tx=0x7f502401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e4329847de20c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024001a90 con 0x7f5014004d50 2024-09-15T22:56:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5024003b80 con 0x7f5014004d50 2024-09-15T22:56:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f502a7fc640 1 -- 172.21.15.28:0/222777433 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024005080 con 0x7f5014004d50 2024-09-15T22:56:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- 172.21.15.28:0/222777433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5014004d50 msgr2=0x7f50140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 --2- 172.21.15.28:0/222777433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5014004d50 0x7f50140051d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5024001e40 tx=0x7f502401c760 comp rx=0 tx=0).stop 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f502bfff640 1 -- 172.21.15.28:0/222777433 reap_dead start 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- 172.21.15.28:0/222777433 shutdown_connections 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- 172.21.15.28:0/222777433 >> 172.21.15.28:0/222777433 conn(0x7f502c0b2e10 msgr2=0x7f502c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- 172.21.15.28:0/222777433 shutdown_connections 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- 172.21.15.28:0/222777433 wait complete. 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 Processor -- start 2024-09-15T22:56:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.197+0000 7f5031f6e640 1 -- start start 2024-09-15T22:56:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c0ccce0 0x7f502c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 0x7f502c1e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0af0d0 con 0x7f502c1e3f10 2024-09-15T22:56:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f502c070680 con 0x7f502c0d1580 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f502c0d01a0 con 0x7f502c0ccce0 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46988/0 (socket says 172.21.15.28:46988) 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 -- 172.21.15.28:0/1012860980 learned_addr learned my addr 172.21.15.28:0/1012860980 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502affd640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 0x7f502c1e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502b7fe640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c0ccce0 0x7f502c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 -- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c0ccce0 msgr2=0x7f502c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c0ccce0 0x7f502c0d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 -- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 msgr2=0x7f502c1e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 0x7f502c1e39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 -- 172.21.15.28:0/1012860980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c1e4720 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502affd640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 0x7f502c1e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502bfff640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f502401d000 tx=0x7f5014005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240b8070 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5024006b60 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c148a10 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024001a90 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c148fd0 con 0x7f502c1e3f10 2024-09-15T22:56:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c06ec60 con 0x7f502c1e3f10 2024-09-15T22:56:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50240bb070 con 0x7f502c1e3f10 2024-09-15T22:56:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 0x7f5018069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f502411eea0 con 0x7f502c1e3f10 2024-09-15T22:56:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502b7fe640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 0x7f5018069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.201+0000 7f502b7fe640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 0x7f5018069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f501c001ec0 tx=0x7f501c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.205+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50240ac020 con 0x7f502c1e3f10 2024-09-15T22:56:21.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.381+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f502c0cfb30 con 0x7f502c1e3f10 2024-09-15T22:56:21.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5013fff640 1 -- 172.21.15.28:0/1012860980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16690 (secure 0 0 0) 0x7f5024016470 con 0x7f502c1e3f10 2024-09-15T22:56:21.384 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:21.385 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":19,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:20.357152+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 msgr2=0x7f5018069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 0x7f5018069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f501c001ec0 tx=0x7f501c009040 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 msgr2=0x7f502c14aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f502401d000 tx=0x7f5014005840 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 shutdown_connections 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f502c1e3f10 0x7f502c14aaa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50180678f0 0x7f5018069db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f502c0d1580 0x7f502c1e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 --2- 172.21.15.28:0/1012860980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f502c0ccce0 0x7f502c0d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 >> 172.21.15.28:0/1012860980 conn(0x7f502c0b2e10 msgr2=0x7f502c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 shutdown_connections 2024-09-15T22:56:21.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.385+0000 7f5031f6e640 1 -- 172.21.15.28:0/1012860980 wait complete. 2024-09-15T22:56:21.404 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:21.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 Processor -- start 2024-09-15T22:56:21.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 -- start start 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd58145970 0x7efd580b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd580d0360 0x7efd580cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd580d0960 con 0x7efd580b2300 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7efd580b2770 con 0x7efd580d0360 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd5e217640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7efd580d0f20 con 0x7efd58145970 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd57fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd580d0360 0x7efd580cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd56ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efd580b2300 0x7efd580cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55392/0 (socket says 172.21.15.28:55392) 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd56ffd640 1 -- 172.21.15.28:0/2902857750 learned_addr learned my addr 172.21.15.28:0/2902857750 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:21.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd577fe640 1 --2- 172.21.15.28:0/2902857750 >> v2:172.21.15.131:3300/0 conn(0x7efd58145970 0x7efd580b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd57fff640 1 -- 172.21.15.28:0/2902857750 >> v2:172.21.15.131:3300/0 conn(0x7efd58145970 msgr2=0x7efd580b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:21.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd57fff640 1 --2- 172.21.15.28:0/2902857750 >> v2:172.21.15.131:3300/0 conn(0x7efd58145970 0x7efd580b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd57fff640 1 -- 172.21.15.28:0/2902857750 >> v1:172.21.15.28:6789/0 conn(0x7efd580b2300 legacy=0x7efd580cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd57fff640 1 -- 172.21.15.28:0/2902857750 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd580d0c40 con 0x7efd580d0360 2024-09-15T22:56:21.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.533+0000 7efd567fc640 1 -- 172.21.15.28:0/2902857750 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547324024 0 0) 0x7efd580d0960 con 0x7efd580b2300 2024-09-15T22:56:21.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- 172.21.15.28:0/2902857750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd580d0360 0x7efd580cdab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd50009d90 tx=0x7efd5001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd1c15d6a957f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd567fc640 1 -- 172.21.15.28:0/2902857750 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b2070 con 0x7efd580d0360 2024-09-15T22:56:21.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd567fc640 1 -- 172.21.15.28:0/2902857750 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd500a5870 con 0x7efd580d0360 2024-09-15T22:56:21.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd567fc640 1 -- 172.21.15.28:0/2902857750 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500a5c40 con 0x7efd580d0360 2024-09-15T22:56:21.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- 172.21.15.28:0/2902857750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd580d0360 msgr2=0x7efd580cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- 172.21.15.28:0/2902857750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd580d0360 0x7efd580cdab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd50009d90 tx=0x7efd5001c8a0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- 172.21.15.28:0/2902857750 shutdown_connections 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- 172.21.15.28:0/2902857750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd580d0360 0x7efd580cdab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- 172.21.15.28:0/2902857750 >> v2:172.21.15.131:3300/0 conn(0x7efd58145970 0x7efd580b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- 172.21.15.28:0/2902857750 >> 172.21.15.28:0/2902857750 conn(0x7efd5806bcc0 msgr2=0x7efd5806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- 172.21.15.28:0/2902857750 shutdown_connections 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- 172.21.15.28:0/2902857750 wait complete. 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 Processor -- start 2024-09-15T22:56:21.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- start start 2024-09-15T22:56:21.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd580b2300 0x7efd581424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 0x7efd581f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd580ceb90 con 0x7efd58145970 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd580cea10 con 0x7efd580d0360 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd5e217640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efd580ced10 con 0x7efd580b2300 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46998/0 (socket says 172.21.15.28:46998) 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 -- 172.21.15.28:0/447284879 learned_addr learned my addr 172.21.15.28:0/447284879 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd577fe640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd580b2300 0x7efd581424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd56ffd640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 0x7efd581f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 -- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd580b2300 msgr2=0x7efd581424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd580b2300 0x7efd581424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 -- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 msgr2=0x7efd581f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 0x7efd581f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 -- 172.21.15.28:0/447284879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd581fa7b0 con 0x7efd58145970 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd56ffd640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 0x7efd581f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.537+0000 7efd57fff640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd500b0040 tx=0x7efd50019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500bd020 con 0x7efd58145970 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd500b8470 con 0x7efd58145970 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd581faa90 con 0x7efd58145970 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b2040 con 0x7efd58145970 2024-09-15T22:56:21.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd581fb050 con 0x7efd58145970 2024-09-15T22:56:21.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd580cdab0 con 0x7efd58145970 2024-09-15T22:56:21.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd500c0020 con 0x7efd58145970 2024-09-15T22:56:21.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 0x7efd38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7efd50120720 con 0x7efd58145970 2024-09-15T22:56:21.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd577fe640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 0x7efd38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.541+0000 7efd577fe640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 0x7efd38069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd5815f5d0 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.545+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd500c7070 con 0x7efd58145970 2024-09-15T22:56:21.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.709+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd58073eb0 con 0x7efd58145970 2024-09-15T22:56:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.709+0000 7efd4ffff640 1 -- 172.21.15.28:0/447284879 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16690 (secure 0 0 0) 0x7efd50016520 con 0x7efd58145970 2024-09-15T22:56:21.712 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:21.712 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":19,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:20.357152+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 msgr2=0x7efd38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 0x7efd38069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd5815f5d0 tx=0x7efd40008040 comp rx=0 tx=0).stop 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 msgr2=0x7efd581f7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd500b0040 tx=0x7efd50019640 comp rx=0 tx=0).stop 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 shutdown_connections 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd58145970 0x7efd581f7c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd380678f0 0x7efd38069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd580d0360 0x7efd581f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 --2- 172.21.15.28:0/447284879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd580b2300 0x7efd581424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 >> 172.21.15.28:0/447284879 conn(0x7efd5806bcc0 msgr2=0x7efd5815c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 shutdown_connections 2024-09-15T22:56:21.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.713+0000 7efd5e217640 1 -- 172.21.15.28:0/447284879 wait complete. 2024-09-15T22:56:21.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:56:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 Processor -- start 2024-09-15T22:56:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 -- start start 2024-09-15T22:56:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ad806c3d0 0x7f2ad80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad80b4110 con 0x7f2ad815c2d0 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad80b43f0 con 0x7f2ad806fb50 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2add0a2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad80b6540 con 0x7f2ad806c3d0 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad6d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2ad815c2d0 0x7f2ad806bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55396/0 (socket says 172.21.15.28:55396) 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ad806c3d0 0x7f2ad80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad6d9d640 1 -- 172.21.15.28:0/3382652170 learned_addr learned my addr 172.21.15.28:0/3382652170 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad5d9b640 1 -- 172.21.15.28:0/3382652170 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983185330 0 0) 0x7f2ad80b4110 con 0x7f2ad815c2d0 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad5d9b640 1 -- 172.21.15.28:0/3382652170 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac0003530 con 0x7f2ad815c2d0 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad659c640 1 -- 172.21.15.28:0/3382652170 >> v1:172.21.15.131:6789/0 conn(0x7f2ad806fb50 legacy=0x7f2ad80cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad659c640 1 -- 172.21.15.28:0/3382652170 >> v1:172.21.15.28:6789/0 conn(0x7f2ad815c2d0 legacy=0x7f2ad806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.853+0000 7f2ad659c640 1 -- 172.21.15.28:0/3382652170 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad80b46d0 con 0x7f2ad806c3d0 2024-09-15T22:56:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2ad659c640 1 --2- 172.21.15.28:0/3382652170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806c3d0 0x7f2ad80cf130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0097c0 tx=0x7f2ad80d0590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580228c48b7db72c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2ad5d9b640 1 -- 172.21.15.28:0/3382652170 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0ab430 con 0x7f2ad806c3d0 2024-09-15T22:56:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2ad5d9b640 1 -- 172.21.15.28:0/3382652170 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc0b0070 con 0x7f2ad806c3d0 2024-09-15T22:56:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2ad5d9b640 1 -- 172.21.15.28:0/3382652170 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0ab7d0 con 0x7f2ad806c3d0 2024-09-15T22:56:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- 172.21.15.28:0/3382652170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806c3d0 msgr2=0x7f2ad80cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 --2- 172.21.15.28:0/3382652170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806c3d0 0x7f2ad80cf130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0097c0 tx=0x7f2ad80d0590 comp rx=0 tx=0).stop 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- 172.21.15.28:0/3382652170 shutdown_connections 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 --2- 172.21.15.28:0/3382652170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806c3d0 0x7f2ad80cf130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- 172.21.15.28:0/3382652170 >> 172.21.15.28:0/3382652170 conn(0x7f2ad80b2e10 msgr2=0x7f2ad80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- 172.21.15.28:0/3382652170 shutdown_connections 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- 172.21.15.28:0/3382652170 wait complete. 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 Processor -- start 2024-09-15T22:56:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 -- start start 2024-09-15T22:56:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad806c3d0 0x7f2ad814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.857+0000 7f2add0a2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad815c2d0 0x7f2ad8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8169eb0 con 0x7f2ad806fb50 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad815c6b0 con 0x7f2ad815c2d0 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad816a030 con 0x7f2ad806c3d0 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad6d9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad806c3d0 0x7f2ad814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad759e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad815c2d0 0x7f2ad8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47012/0 (socket says 172.21.15.28:47012) 2024-09-15T22:56:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 -- 172.21.15.28:0/446899506 learned_addr learned my addr 172.21.15.28:0/446899506 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 -- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad806c3d0 msgr2=0x7f2ad814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad806c3d0 0x7f2ad814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 -- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad815c2d0 msgr2=0x7f2ad8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad815c2d0 0x7f2ad8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 -- 172.21.15.28:0/446899506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad8072ce0 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad659c640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2acc01aae0 tx=0x7f2acc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0be5f0 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc0be790 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad8072fc0 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0beb40 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad8073580 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad80b4110 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2acc0b43f0 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 0x7f2ac4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad6d9d640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 0x7f2ac4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f2acc0a8070 con 0x7f2ad806fb50 2024-09-15T22:56:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.861+0000 7f2ad6d9d640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 0x7f2ac4069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8007fd0 tx=0x7f2ac8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:21.869+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2acc016050 con 0x7f2ad806fb50 2024-09-15T22:56:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:22.069+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2ad806cbb0 con 0x7f2ad806fb50 2024-09-15T22:56:23.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.009+0000 7f2abf7fe640 1 -- 172.21.15.28:0/446899506 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f2acc0f0a60 con 0x7f2ad806fb50 2024-09-15T22:56:23.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 msgr2=0x7f2ac4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 0x7f2ac4069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8007fd0 tx=0x7f2ac8009040 comp rx=0 tx=0).stop 2024-09-15T22:56:23.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 msgr2=0x7f2ad80cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2acc01aae0 tx=0x7f2acc01ac70 comp rx=0 tx=0).stop 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 shutdown_connections 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2ac40678f0 0x7f2ac4069db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad815c2d0 0x7f2ad8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ad806fb50 0x7f2ad80cbf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 --2- 172.21.15.28:0/446899506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad806c3d0 0x7f2ad814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 >> 172.21.15.28:0/446899506 conn(0x7f2ad80b2e10 msgr2=0x7f2ad80d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 shutdown_connections 2024-09-15T22:56:23.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.013+0000 7f2add0a2640 1 -- 172.21.15.28:0/446899506 wait complete. 2024-09-15T22:56:23.034 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:56:23.034 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 Processor -- start 2024-09-15T22:56:23.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 -- start start 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 0x7f70d00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70d00b2370 0x7f70d00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d0073a40 con 0x7f70d0145b20 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f70d00b27c0 con 0x7f70d00b2370 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70d575a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70d0072ec0 con 0x7f70d0072a30 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70cf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70d00b2370 0x7f70d00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70ceffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f70d0145b20 0x7f70d0072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44914/0 (socket says 172.21.15.28:44914) 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70ceffd640 1 -- 172.21.15.28:0/3922083607 learned_addr learned my addr 172.21.15.28:0/3922083607 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70ce7fc640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 0x7f70d00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70cf7fe640 1 -- 172.21.15.28:0/3922083607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 msgr2=0x7f70d00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70cf7fe640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 0x7f70d00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70cf7fe640 1 -- 172.21.15.28:0/3922083607 >> v1:172.21.15.28:6789/0 conn(0x7f70d0145b20 legacy=0x7f70d0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70cf7fe640 1 -- 172.21.15.28:0/3922083607 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d00731a0 con 0x7f70d00b2370 2024-09-15T22:56:23.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.165+0000 7f70ce7fc640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 0x7f70d00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70cf7fe640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d00cf720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009d90 tx=0x7f70c801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85f1c66f70abbad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70cdffb640 1 -- 172.21.15.28:0/3922083607 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80b2070 con 0x7f70d00b2370 2024-09-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70cdffb640 1 -- 172.21.15.28:0/3922083607 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c80a5970 con 0x7f70d00b2370 2024-09-15T22:56:23.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70cdffb640 1 -- 172.21.15.28:0/3922083607 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a5d40 con 0x7f70d00b2370 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- 172.21.15.28:0/3922083607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 msgr2=0x7f70d00cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d00cf720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009d90 tx=0x7f70c801c8b0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- 172.21.15.28:0/3922083607 shutdown_connections 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d00cf720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- 172.21.15.28:0/3922083607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0072a30 0x7f70d00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- 172.21.15.28:0/3922083607 >> 172.21.15.28:0/3922083607 conn(0x7f70d006bcc0 msgr2=0x7f70d006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- 172.21.15.28:0/3922083607 shutdown_connections 2024-09-15T22:56:23.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- 172.21.15.28:0/3922083607 wait complete. 2024-09-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 Processor -- start 2024-09-15T22:56:23.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- start start 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0145b20 0x7f70d0144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d00b3670 0x7f70d00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0146080 con 0x7f70d00b2370 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0145f00 con 0x7f70d00b3670 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.169+0000 7f70d575a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f70d00d0470 con 0x7f70d0145b20 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34392/0 (socket says 172.21.15.28:34392) 2024-09-15T22:56:23.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 -- 172.21.15.28:0/448852526 learned_addr learned my addr 172.21.15.28:0/448852526 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70cf7fe640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d00b3670 0x7f70d00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ce7fc640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0145b20 0x7f70d0144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 -- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0145b20 msgr2=0x7f70d0144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0145b20 0x7f70d0144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 -- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d00b3670 msgr2=0x7f70d00b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d00b3670 0x7f70d00b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 -- 172.21.15.28:0/448852526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d0144940 con 0x7f70d00b2370 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ceffd640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c3a0 tx=0x7f70c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0017070 con 0x7f70d00b2370 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c0005cf0 con 0x7f70d00b2370 2024-09-15T22:56:23.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c00072f0 con 0x7f70d00b2370 2024-09-15T22:56:23.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d0144c20 con 0x7f70d00b2370 2024-09-15T22:56:23.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d00b4060 con 0x7f70d00b2370 2024-09-15T22:56:23.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d0069220 con 0x7f70d00b2370 2024-09-15T22:56:23.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70c001a070 con 0x7f70d00b2370 2024-09-15T22:56:23.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 0x7f70bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f70c0084fb0 con 0x7f70d00b2370 2024-09-15T22:56:23.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.173+0000 7f70ce7fc640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 0x7f70bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.177+0000 7f70ce7fc640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 0x7f70bc069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70d0073d60 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.181+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70c0055af0 con 0x7f70d00b2370 2024-09-15T22:56:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:23.377+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f70d00d0900 con 0x7f70d00b2370 2024-09-15T22:56:24.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70b77fe640 1 -- 172.21.15.28:0/448852526 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f70c00553f0 con 0x7f70d00b2370 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 msgr2=0x7f70bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 0x7f70bc069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70d0073d60 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 msgr2=0x7f70d0143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70c000c3a0 tx=0x7f70c000c860 comp rx=0 tx=0).stop 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 shutdown_connections 2024-09-15T22:56:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f70bc0678c0 0x7f70bc069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70d00b3670 0x7f70d00b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70d0145b20 0x7f70d0144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 --2- 172.21.15.28:0/448852526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70d00b2370 0x7f70d0143dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 >> 172.21.15.28:0/448852526 conn(0x7f70d006bcc0 msgr2=0x7f70d015e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 shutdown_connections 2024-09-15T22:56:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.025+0000 7f70d575a640 1 -- 172.21.15.28:0/448852526 wait complete. 2024-09-15T22:56:24.047 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:56:24.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 Processor -- start 2024-09-15T22:56:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 -- start start 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65fc145090 0x7f65fc06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc073bc0 con 0x7f65fc073420 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f65fc06d360 con 0x7f65fc145090 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f6601a81640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc0b4110 con 0x7f65fc06cef0 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43114/0 (socket says 172.21.15.28:43114) 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65fb7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65fc145090 0x7f65fc06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 -- 172.21.15.28:0/3704571241 learned_addr learned my addr 172.21.15.28:0/3704571241 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 -- 172.21.15.28:0/3704571241 >> v2:172.21.15.131:3300/0 conn(0x7f65fc145090 msgr2=0x7f65fc06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 --2- 172.21.15.28:0/3704571241 >> v2:172.21.15.131:3300/0 conn(0x7f65fc145090 0x7f65fc06c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 -- 172.21.15.28:0/3704571241 >> v1:172.21.15.131:6789/0 conn(0x7f65fc073420 legacy=0x7f65fc0cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.177+0000 7f65faffd640 1 -- 172.21.15.28:0/3704571241 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc073ea0 con 0x7f65fc06cef0 2024-09-15T22:56:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f65faffd640 1 --2- 172.21.15.28:0/3704571241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f88d0640088f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f65fa7fc640 1 -- 172.21.15.28:0/3704571241 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00ab680 con 0x7f65fc06cef0 2024-09-15T22:56:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f65fa7fc640 1 -- 172.21.15.28:0/3704571241 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f00b0070 con 0x7f65fc06cef0 2024-09-15T22:56:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f65fa7fc640 1 -- 172.21.15.28:0/3704571241 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00aba40 con 0x7f65fc06cef0 2024-09-15T22:56:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 -- 172.21.15.28:0/3704571241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 msgr2=0x7f65fc072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 --2- 172.21.15.28:0/3704571241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f001c560 comp rx=0 tx=0).stop 2024-09-15T22:56:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 -- 172.21.15.28:0/3704571241 shutdown_connections 2024-09-15T22:56:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 --2- 172.21.15.28:0/3704571241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc06cef0 0x7f65fc072ee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 --2- 172.21.15.28:0/3704571241 >> v2:172.21.15.131:3300/0 conn(0x7f65fc145090 0x7f65fc06c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 -- 172.21.15.28:0/3704571241 >> 172.21.15.28:0/3704571241 conn(0x7f65fc0cdbe0 msgr2=0x7f65fc0cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 -- 172.21.15.28:0/3704571241 shutdown_connections 2024-09-15T22:56:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.181+0000 7f6601a81640 1 -- 172.21.15.28:0/3704571241 wait complete. 2024-09-15T22:56:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 Processor -- start 2024-09-15T22:56:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- start start 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65fc06cef0 0x7f65fc0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc145090 0x7f65fc13aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc073830 con 0x7f65fc073420 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc145470 con 0x7f65fc06cef0 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc06fa90 con 0x7f65fc145090 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34396/0 (socket says 172.21.15.28:34396) 2024-09-15T22:56:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 -- 172.21.15.28:0/570886293 learned_addr learned my addr 172.21.15.28:0/570886293 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65fbfff640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc145090 0x7f65fc13aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65fb7fe640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65fc06cef0 0x7f65fc0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 -- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc145090 msgr2=0x7f65fc13aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc145090 0x7f65fc13aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 -- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65fc06cef0 msgr2=0x7f65fc0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65fc06cef0 0x7f65fc0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 -- 172.21.15.28:0/570886293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc0cee20 con 0x7f65fc073420 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65faffd640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f001ce00 tx=0x7f65f001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00be630 con 0x7f65fc073420 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f00a7070 con 0x7f65fc073420 2024-09-15T22:56:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc0cf100 con 0x7f65fc073420 2024-09-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00be9d0 con 0x7f65fc073420 2024-09-15T22:56:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc0cf6c0 con 0x7f65fc073420 2024-09-15T22:56:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.185+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc072ee0 con 0x7f65fc073420 2024-09-15T22:56:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.189+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65f00b43f0 con 0x7f65fc073420 2024-09-15T22:56:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.189+0000 7f65e3fff640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.189+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f65f0120330 con 0x7f65fc073420 2024-09-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.189+0000 7f65fb7fe640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.189+0000 7f65fb7fe640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 0x7f65e8069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009af0 tx=0x7f65ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.193+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65f0016150 con 0x7f65fc073420 2024-09-15T22:56:24.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.389+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65fc143e00 con 0x7f65fc073420 2024-09-15T22:56:24.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.389+0000 7f65e3fff640 1 -- 172.21.15.28:0/570886293 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f65f00f0f90 con 0x7f65fc073420 2024-09-15T22:56:24.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:24.393 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:24.393 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:24.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 msgr2=0x7f65e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 0x7f65e8069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009af0 tx=0x7f65ec008040 comp rx=0 tx=0).stop 2024-09-15T22:56:24.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 msgr2=0x7f65fc15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f001ce00 tx=0x7f65f001ada0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 shutdown_connections 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65fc145090 0x7f65fc13aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65fc073420 0x7f65fc15bb20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f65e80678c0 0x7f65e8069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 --2- 172.21.15.28:0/570886293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65fc06cef0 0x7f65fc0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 >> 172.21.15.28:0/570886293 conn(0x7f65fc0cdbe0 msgr2=0x7f65fc13c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 shutdown_connections 2024-09-15T22:56:24.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.393+0000 7f6601a81640 1 -- 172.21.15.28:0/570886293 wait complete. 2024-09-15T22:56:24.410 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:24.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.533+0000 7f929e933640 1 Processor -- start 2024-09-15T22:56:24.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.533+0000 7f929e933640 1 -- start start 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929e933640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f92980aef20 0x7f92980af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929e933640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92980b4450 con 0x7f92980cfa80 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929e933640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92980af860 con 0x7f929815e370 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929e933640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f92980b4780 con 0x7f92980aef20 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f92980aef20 0x7f92980af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f92980aef20 0x7f92980af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34408/0 (socket says 172.21.15.28:34408) 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f928f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f92980cfa80 0x7f92980b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44928/0 (socket says 172.21.15.28:44928) 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 -- 172.21.15.28:0/1948972861 learned_addr learned my addr 172.21.15.28:0/1948972861 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:24.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 -- 172.21.15.28:0/1948972861 >> v1:172.21.15.131:6789/0 conn(0x7f929815e370 legacy=0x7f92980b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:24.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 -- 172.21.15.28:0/1948972861 >> v1:172.21.15.28:6789/0 conn(0x7f92980cfa80 legacy=0x7f92980b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 -- 172.21.15.28:0/1948972861 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92980b3960 con 0x7f92980aef20 2024-09-15T22:56:24.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f929ced0640 1 --2- 172.21.15.28:0/1948972861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f92980af320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb467c47341c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f92977fe640 1 -- 172.21.15.28:0/1948972861 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900a57a0 con 0x7f92980aef20 2024-09-15T22:56:24.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f92977fe640 1 -- 172.21.15.28:0/1948972861 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92900a5940 con 0x7f92980aef20 2024-09-15T22:56:24.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.537+0000 7f92977fe640 1 -- 172.21.15.28:0/1948972861 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900a5d10 con 0x7f92980aef20 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/1948972861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 msgr2=0x7f92980af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 --2- 172.21.15.28:0/1948972861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f92980af320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e50 tx=0x7f929001c9f0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/1948972861 shutdown_connections 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 --2- 172.21.15.28:0/1948972861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f92980af320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/1948972861 >> 172.21.15.28:0/1948972861 conn(0x7f929806bcc0 msgr2=0x7f929806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/1948972861 shutdown_connections 2024-09-15T22:56:24.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/1948972861 wait complete. 2024-09-15T22:56:24.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 Processor -- start 2024-09-15T22:56:24.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- start start 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980cfa80 0x7f9298153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f929815e370 0x7f929814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92980b54a0 con 0x7f92980aef20 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f92980b5320 con 0x7f92980cfa80 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f929816c090 con 0x7f929815e370 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34414/0 (socket says 172.21.15.28:34414) 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 -- 172.21.15.28:0/683897827 learned_addr learned my addr 172.21.15.28:0/683897827 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 -- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f929815e370 msgr2=0x7f929814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f929815e370 0x7f929814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 -- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980cfa80 msgr2=0x7f9298153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980cfa80 0x7f9298153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 -- 172.21.15.28:0/683897827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92981526a0 con 0x7f92980aef20 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f9297fff640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f928800b410 tx=0x7f928800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288015030 con 0x7f92980aef20 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288004020 con 0x7f92980aef20 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9298152980 con 0x7f92980aef20 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288004450 con 0x7f92980aef20 2024-09-15T22:56:24.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.541+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9298152f40 con 0x7f92980aef20 2024-09-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92980af320 con 0x7f92980aef20 2024-09-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9288018070 con 0x7f92980aef20 2024-09-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f92957fa640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 0x7f9278069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f92880858c0 con 0x7f92980aef20 2024-09-15T22:56:24.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f928f7fe640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 0x7f9278069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.545+0000 7f928f7fe640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 0x7f9278069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f70 tx=0x7f9280007a10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.549+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9288056400 con 0x7f92980aef20 2024-09-15T22:56:24.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.713+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f929814e2f0 con 0x7f92980aef20 2024-09-15T22:56:24.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f92957fa640 1 -- 172.21.15.28:0/683897827 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7f9288055d00 con 0x7f92980aef20 2024-09-15T22:56:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:24.717 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 msgr2=0x7f9278069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 0x7f9278069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f70 tx=0x7f9280007a10 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 msgr2=0x7f929814ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f928800b410 tx=0x7f928800b8d0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 shutdown_connections 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f929815e370 0x7f929814eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92780678c0 0x7f9278069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980cfa80 0x7f9298153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 --2- 172.21.15.28:0/683897827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92980aef20 0x7f929814ddb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 >> 172.21.15.28:0/683897827 conn(0x7f929806bcc0 msgr2=0x7f92980b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 shutdown_connections 2024-09-15T22:56:24.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.717+0000 7f929e933640 1 -- 172.21.15.28:0/683897827 wait complete. 2024-09-15T22:56:24.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:56:24.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:24.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.857+0000 7f7fb36a5640 1 Processor -- start 2024-09-15T22:56:24.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.857+0000 7f7fb36a5640 1 -- start start 2024-09-15T22:56:24.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb36a5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 0x7f7fac0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb36a5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7fac0d0360 0x7f7fac0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb36a5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fac0d0960 con 0x7f7fac0b2300 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb36a5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f7fac0b2770 con 0x7f7fac0d0360 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb36a5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7fac0d0f20 con 0x7f7fac145970 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7fac0d0360 0x7f7fac0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb0c40640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7fac0b2300 0x7f7fac0cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44940/0 (socket says 172.21.15.28:44940) 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb0c40640 1 -- 172.21.15.28:0/483501571 learned_addr learned my addr 172.21.15.28:0/483501571 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1441640 1 --2- 172.21.15.28:0/483501571 >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 0x7f7fac0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 -- 172.21.15.28:0/483501571 >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 msgr2=0x7f7fac0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 --2- 172.21.15.28:0/483501571 >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 0x7f7fac0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 -- 172.21.15.28:0/483501571 >> v1:172.21.15.28:6789/0 conn(0x7f7fac0b2300 legacy=0x7f7fac0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 -- 172.21.15.28:0/483501571 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac0d0c40 con 0x7f7fac0d0360 2024-09-15T22:56:24.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fa3fff640 1 -- 172.21.15.28:0/483501571 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921033496 0 0) 0x7f7fac0d0960 con 0x7f7fac0b2300 2024-09-15T22:56:24.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1441640 1 --2- 172.21.15.28:0/483501571 >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 0x7f7fac0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:24.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fb1c42640 1 --2- 172.21.15.28:0/483501571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cdab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009d90 tx=0x7f7fa401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f677a7a8798c79c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fa3fff640 1 -- 172.21.15.28:0/483501571 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b2070 con 0x7f7fac0d0360 2024-09-15T22:56:24.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fa3fff640 1 -- 172.21.15.28:0/483501571 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a5870 con 0x7f7fac0d0360 2024-09-15T22:56:24.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.861+0000 7f7fa3fff640 1 -- 172.21.15.28:0/483501571 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5c40 con 0x7f7fac0d0360 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/483501571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac0d0360 msgr2=0x7f7fac0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/483501571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cdab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009d90 tx=0x7f7fa401c8a0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/483501571 shutdown_connections 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/483501571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cdab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/483501571 >> v2:172.21.15.131:3300/0 conn(0x7f7fac145970 0x7f7fac0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/483501571 >> 172.21.15.28:0/483501571 conn(0x7f7fac06bcc0 msgr2=0x7f7fac06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/483501571 shutdown_connections 2024-09-15T22:56:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/483501571 wait complete. 2024-09-15T22:56:24.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 Processor -- start 2024-09-15T22:56:24.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- start start 2024-09-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac0b2300 0x7f7fac0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac0ceb90 con 0x7f7fac145970 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac0cea10 con 0x7f7fac0d0360 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac0ced10 con 0x7f7fac0b2300 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34446/0 (socket says 172.21.15.28:34446) 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 -- 172.21.15.28:0/1733819175 learned_addr learned my addr 172.21.15.28:0/1733819175 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1441640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac0b2300 0x7f7fac0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb0c40640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 -- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac0b2300 msgr2=0x7f7fac0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac0b2300 0x7f7fac0b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 -- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac0d0360 msgr2=0x7f7fac0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:24.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 -- 172.21.15.28:0/1733819175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac0b4b50 con 0x7f7fac145970 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb1c42640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b0040 tx=0x7f7fa4019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b2050 con 0x7f7fac145970 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40be070 con 0x7f7fac145970 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fac0b4df0 con 0x7f7fac145970 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40ada50 con 0x7f7fac145970 2024-09-15T22:56:24.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.865+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fac0b3e00 con 0x7f7fac145970 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac0cdab0 con 0x7f7fac145970 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fa40adbf0 con 0x7f7fac145970 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fa1ffb640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 0x7f7f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7fa4120db0 con 0x7f7fac145970 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fb1441640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 0x7f7f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:24.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.869+0000 7f7fb1441640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 0x7f7f90069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8006fd0 tx=0x7f7fa8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:24.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:24.873+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fa4016520 con 0x7f7fac145970 2024-09-15T22:56:25.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.029+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fac0d00e0 con 0x7f7f900678c0 2024-09-15T22:56:25.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.033+0000 7f7fa1ffb640 1 -- 172.21.15.28:0/1733819175 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246629 (secure 0 0 0) 0x7f7fac0d00e0 con 0x7f7f900678c0 2024-09-15T22:56:25.037 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 msgr2=0x7f7f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 0x7f7f90069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8006fd0 tx=0x7f7fa8008040 comp rx=0 tx=0).stop 2024-09-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 msgr2=0x7f7fac137fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b0040 tx=0x7f7fa4019640 comp rx=0 tx=0).stop 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 shutdown_connections 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fac145970 0x7f7fac137fa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7f900678c0 0x7f7f90069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fac0d0360 0x7f7fac0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 --2- 172.21.15.28:0/1733819175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fac0b2300 0x7f7fac0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.037+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 >> 172.21.15.28:0/1733819175 conn(0x7f7fac06bcc0 msgr2=0x7f7fac15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.041+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 shutdown_connections 2024-09-15T22:56:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.041+0000 7f7fb36a5640 1 -- 172.21.15.28:0/1733819175 wait complete. 2024-09-15T22:56:25.055 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-15T22:56:23.867475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235352,"kb_used_data":2484,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739368,"statfs":{"total":773094113280,"available":772853112832,"internally_reserved":0,"allocated":2543616,"data_stored":1599683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999967+0000","last_change":"2024-09-15T22:56:19.999967+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999967+0000","last_undegraded":"2024-09-15T22:56:19.999967+0000","last_fullsized":"2024-09-15T22:56:19.999967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989863+0000","last_change":"2024-09-15T22:56:19.989863+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989863+0000","last_undegraded":"2024-09-15T22:56:19.989863+0000","last_fullsized":"2024-09-15T22:56:19.989863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992776+0000","last_change":"2024-09-15T22:56:19.992776+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992776+0000","last_undegraded":"2024-09-15T22:56:19.992776+0000","last_fullsized":"2024-09-15T22:56:19.992776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994974+0000","last_change":"2024-09-15T22:56:19.994974+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994974+0000","last_undegraded":"2024-09-15T22:56:19.994974+0000","last_fullsized":"2024-09-15T22:56:19.994974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992877+0000","last_change":"2024-09-15T22:56:19.992877+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992877+0000","last_undegraded":"2024-09-15T22:56:19.992877+0000","last_fullsized":"2024-09-15T22:56:19.992877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999894+0000","last_change":"2024-09-15T22:56:19.999894+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999894+0000","last_undegraded":"2024-09-15T22:56:19.999894+0000","last_fullsized":"2024-09-15T22:56:19.999894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994033+0000","last_change":"2024-09-15T22:56:19.994033+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994033+0000","last_undegraded":"2024-09-15T22:56:19.994033+0000","last_fullsized":"2024-09-15T22:56:19.994033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998038+0000","last_change":"2024-09-15T22:56:19.998038+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998038+0000","last_undegraded":"2024-09-15T22:56:19.998038+0000","last_fullsized":"2024-09-15T22:56:19.998038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995462+0000","last_change":"2024-09-15T22:56:19.995462+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995462+0000","last_undegraded":"2024-09-15T22:56:19.995462+0000","last_fullsized":"2024-09-15T22:56:19.995462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014944+0000","last_change":"2024-09-15T22:56:20.014944+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014944+0000","last_undegraded":"2024-09-15T22:56:20.014944+0000","last_fullsized":"2024-09-15T22:56:20.014944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991946+0000","last_change":"2024-09-15T22:56:19.991946+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991946+0000","last_undegraded":"2024-09-15T22:56:19.991946+0000","last_fullsized":"2024-09-15T22:56:19.991946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988652+0000","last_change":"2024-09-15T22:56:19.988652+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988652+0000","last_undegraded":"2024-09-15T22:56:19.988652+0000","last_fullsized":"2024-09-15T22:56:19.988652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.002453+0000","last_change":"2024-09-15T22:56:20.002453+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.002453+0000","last_undegraded":"2024-09-15T22:56:20.002453+0000","last_fullsized":"2024-09-15T22:56:20.002453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999827+0000","last_change":"2024-09-15T22:56:19.999827+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999827+0000","last_undegraded":"2024-09-15T22:56:19.999827+0000","last_fullsized":"2024-09-15T22:56:19.999827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989752+0000","last_change":"2024-09-15T22:56:19.989752+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989752+0000","last_undegraded":"2024-09-15T22:56:19.989752+0000","last_fullsized":"2024-09-15T22:56:19.989752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993848+0000","last_change":"2024-09-15T22:56:19.993848+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993848+0000","last_undegraded":"2024-09-15T22:56:19.993848+0000","last_fullsized":"2024-09-15T22:56:19.993848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.986296+0000","last_change":"2024-09-15T22:56:19.986296+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.986296+0000","last_undegraded":"2024-09-15T22:56:19.986296+0000","last_fullsized":"2024-09-15T22:56:19.986296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987524+0000","last_change":"2024-09-15T22:56:19.987524+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987524+0000","last_undegraded":"2024-09-15T22:56:19.987524+0000","last_fullsized":"2024-09-15T22:56:19.987524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006588+0000","last_change":"2024-09-15T22:56:20.006588+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006588+0000","last_undegraded":"2024-09-15T22:56:20.006588+0000","last_fullsized":"2024-09-15T22:56:20.006588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993379+0000","last_change":"2024-09-15T22:56:19.993379+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993379+0000","last_undegraded":"2024-09-15T22:56:19.993379+0000","last_fullsized":"2024-09-15T22:56:19.993379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007240+0000","last_change":"2024-09-15T22:56:20.007240+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007240+0000","last_undegraded":"2024-09-15T22:56:20.007240+0000","last_fullsized":"2024-09-15T22:56:20.007240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998141+0000","last_change":"2024-09-15T22:56:19.998141+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998141+0000","last_undegraded":"2024-09-15T22:56:19.998141+0000","last_fullsized":"2024-09-15T22:56:19.998141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.997311+0000","last_change":"2024-09-15T22:56:19.997311+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.997311+0000","last_undegraded":"2024-09-15T22:56:19.997311+0000","last_fullsized":"2024-09-15T22:56:19.997311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987655+0000","last_change":"2024-09-15T22:56:19.987655+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987655+0000","last_undegraded":"2024-09-15T22:56:19.987655+0000","last_fullsized":"2024-09-15T22:56:19.987655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.000313+0000","last_change":"2024-09-15T22:56:20.000313+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.000313+0000","last_undegraded":"2024-09-15T22:56:20.000313+0000","last_fullsized":"2024-09-15T22:56:20.000313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.005100+0000","last_change":"2024-09-15T22:56:20.005100+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.005100+0000","last_undegraded":"2024-09-15T22:56:20.005100+0000","last_fullsized":"2024-09-15T22:56:20.005100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988951+0000","last_change":"2024-09-15T22:56:19.988951+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988951+0000","last_undegraded":"2024-09-15T22:56:19.988951+0000","last_fullsized":"2024-09-15T22:56:19.988951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996166+0000","last_change":"2024-09-15T22:56:19.996166+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996166+0000","last_undegraded":"2024-09-15T22:56:19.996166+0000","last_fullsized":"2024-09-15T22:56:19.996166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006410+0000","last_change":"2024-09-15T22:56:20.006410+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006410+0000","last_undegraded":"2024-09-15T22:56:20.006410+0000","last_fullsized":"2024-09-15T22:56:20.006410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995991+0000","last_change":"2024-09-15T22:56:19.995991+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995991+0000","last_undegraded":"2024-09-15T22:56:19.995991+0000","last_fullsized":"2024-09-15T22:56:19.995991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987212+0000","last_change":"2024-09-15T22:56:19.987212+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987212+0000","last_undegraded":"2024-09-15T22:56:19.987212+0000","last_fullsized":"2024-09-15T22:56:19.987212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998605+0000","last_change":"2024-09-15T22:56:19.998605+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998605+0000","last_undegraded":"2024-09-15T22:56:19.998605+0000","last_fullsized":"2024-09-15T22:56:19.998605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985845+0000","last_change":"2024-09-15T22:56:19.985845+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985845+0000","last_undegraded":"2024-09-15T22:56:19.985845+0000","last_fullsized":"2024-09-15T22:56:19.985845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.020639+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:20.020639+0000","last_peered":"2024-09-15T22:56:20.020639+0000","last_clean":"2024-09-15T22:56:20.020639+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:20.020639+0000","last_undegraded":"2024-09-15T22:56:20.020639+0000","last_fullsized":"2024-09-15T22:56:20.020639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994960+0000","last_change":"2024-09-15T22:56:19.994960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994960+0000","last_undegraded":"2024-09-15T22:56:19.994960+0000","last_fullsized":"2024-09-15T22:56:19.994960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028259+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:20.028259+0000","last_peered":"2024-09-15T22:56:20.028259+0000","last_clean":"2024-09-15T22:56:20.028259+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:20.028259+0000","last_undegraded":"2024-09-15T22:56:20.028259+0000","last_fullsized":"2024-09-15T22:56:20.028259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027496+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:20.027496+0000","last_peered":"2024-09-15T22:56:20.027496+0000","last_clean":"2024-09-15T22:56:20.027496+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:20.027496+0000","last_undegraded":"2024-09-15T22:56:20.027496+0000","last_fullsized":"2024-09-15T22:56:20.027496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996831+0000","last_change":"2024-09-15T22:56:19.996831+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996831+0000","last_undegraded":"2024-09-15T22:56:19.996831+0000","last_fullsized":"2024-09-15T22:56:19.996831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012753+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:20.012753+0000","last_peered":"2024-09-15T22:56:20.012753+0000","last_clean":"2024-09-15T22:56:20.012753+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:20.012753+0000","last_undegraded":"2024-09-15T22:56:20.012753+0000","last_fullsized":"2024-09-15T22:56:20.012753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:15.954127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988501+0000","last_change":"2024-09-15T22:56:19.988501+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988501+0000","last_undegraded":"2024-09-15T22:56:19.988501+0000","last_fullsized":"2024-09-15T22:56:19.988501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027968+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:20.027968+0000","last_peered":"2024-09-15T22:56:20.027968+0000","last_clean":"2024-09-15T22:56:20.027968+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:20.027968+0000","last_undegraded":"2024-09-15T22:56:20.027968+0000","last_fullsized":"2024-09-15T22:56:20.027968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987423+0000","last_change":"2024-09-15T22:56:19.987423+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987423+0000","last_undegraded":"2024-09-15T22:56:19.987423+0000","last_fullsized":"2024-09-15T22:56:19.987423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028178+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:20.028178+0000","last_peered":"2024-09-15T22:56:20.028178+0000","last_clean":"2024-09-15T22:56:20.028178+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:20.028178+0000","last_undegraded":"2024-09-15T22:56:20.028178+0000","last_fullsized":"2024-09-15T22:56:20.028178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995682+0000","last_change":"2024-09-15T22:56:19.995682+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995682+0000","last_undegraded":"2024-09-15T22:56:19.995682+0000","last_fullsized":"2024-09-15T22:56:19.995682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016489+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:20.016489+0000","last_peered":"2024-09-15T22:56:20.016489+0000","last_clean":"2024-09-15T22:56:20.016489+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:20.016489+0000","last_undegraded":"2024-09-15T22:56:20.016489+0000","last_fullsized":"2024-09-15T22:56:20.016489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.983761+0000","last_change":"2024-09-15T22:56:19.983761+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.983761+0000","last_undegraded":"2024-09-15T22:56:19.983761+0000","last_fullsized":"2024-09-15T22:56:19.983761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028294+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:20.028294+0000","last_peered":"2024-09-15T22:56:20.028294+0000","last_clean":"2024-09-15T22:56:20.028294+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:20.028294+0000","last_undegraded":"2024-09-15T22:56:20.028294+0000","last_fullsized":"2024-09-15T22:56:20.028294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014809+0000","last_change":"2024-09-15T22:56:20.014809+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014809+0000","last_undegraded":"2024-09-15T22:56:20.014809+0000","last_fullsized":"2024-09-15T22:56:20.014809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012371+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:20.012371+0000","last_peered":"2024-09-15T22:56:20.012371+0000","last_clean":"2024-09-15T22:56:20.012371+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:20.012371+0000","last_undegraded":"2024-09-15T22:56:20.012371+0000","last_fullsized":"2024-09-15T22:56:20.012371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992292+0000","last_change":"2024-09-15T22:56:19.992292+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992292+0000","last_undegraded":"2024-09-15T22:56:19.992292+0000","last_fullsized":"2024-09-15T22:56:19.992292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013872+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:20.013872+0000","last_peered":"2024-09-15T22:56:20.013872+0000","last_clean":"2024-09-15T22:56:20.013872+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:20.013872+0000","last_undegraded":"2024-09-15T22:56:20.013872+0000","last_fullsized":"2024-09-15T22:56:20.013872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991128+0000","last_change":"2024-09-15T22:56:19.991128+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991128+0000","last_undegraded":"2024-09-15T22:56:19.991128+0000","last_fullsized":"2024-09-15T22:56:19.991128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028302+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:20.028302+0000","last_peered":"2024-09-15T22:56:20.028302+0000","last_clean":"2024-09-15T22:56:20.028302+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:20.028302+0000","last_undegraded":"2024-09-15T22:56:20.028302+0000","last_fullsized":"2024-09-15T22:56:20.028302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992976+0000","last_change":"2024-09-15T22:56:19.992976+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992976+0000","last_undegraded":"2024-09-15T22:56:19.992976+0000","last_fullsized":"2024-09-15T22:56:19.992976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:19.995842+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:19.995842+0000","last_peered":"2024-09-15T22:56:19.995842+0000","last_clean":"2024-09-15T22:56:19.995842+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:19.995842+0000","last_undegraded":"2024-09-15T22:56:19.995842+0000","last_fullsized":"2024-09-15T22:56:19.995842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992162+0000","last_change":"2024-09-15T22:56:19.992162+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992162+0000","last_undegraded":"2024-09-15T22:56:19.992162+0000","last_fullsized":"2024-09-15T22:56:19.992162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.014348+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:20.014348+0000","last_peered":"2024-09-15T22:56:20.014348+0000","last_clean":"2024-09-15T22:56:20.014348+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:20.014348+0000","last_undegraded":"2024-09-15T22:56:20.014348+0000","last_fullsized":"2024-09-15T22:56:20.014348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991190+0000","last_change":"2024-09-15T22:56:19.991190+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991190+0000","last_undegraded":"2024-09-15T22:56:19.991190+0000","last_fullsized":"2024-09-15T22:56:19.991190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.010908+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:20.010908+0000","last_peered":"2024-09-15T22:56:20.010908+0000","last_clean":"2024-09-15T22:56:20.010908+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:20.010908+0000","last_undegraded":"2024-09-15T22:56:20.010908+0000","last_fullsized":"2024-09-15T22:56:20.010908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994660+0000","last_change":"2024-09-15T22:56:19.994660+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994660+0000","last_undegraded":"2024-09-15T22:56:19.994660+0000","last_fullsized":"2024-09-15T22:56:19.994660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005340+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:20.005340+0000","last_peered":"2024-09-15T22:56:20.005340+0000","last_clean":"2024-09-15T22:56:20.005340+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:20.005340+0000","last_undegraded":"2024-09-15T22:56:20.005340+0000","last_fullsized":"2024-09-15T22:56:20.005340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991249+0000","last_change":"2024-09-15T22:56:19.991249+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991249+0000","last_undegraded":"2024-09-15T22:56:19.991249+0000","last_fullsized":"2024-09-15T22:56:19.991249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.009183+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:20.009183+0000","last_peered":"2024-09-15T22:56:20.009183+0000","last_clean":"2024-09-15T22:56:20.009183+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:20.009183+0000","last_undegraded":"2024-09-15T22:56:20.009183+0000","last_fullsized":"2024-09-15T22:56:20.009183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007677+0000","last_change":"2024-09-15T22:56:20.007677+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007677+0000","last_undegraded":"2024-09-15T22:56:20.007677+0000","last_fullsized":"2024-09-15T22:56:20.007677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016116+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:20.016116+0000","last_peered":"2024-09-15T22:56:20.016116+0000","last_clean":"2024-09-15T22:56:20.016116+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:20.016116+0000","last_undegraded":"2024-09-15T22:56:20.016116+0000","last_fullsized":"2024-09-15T22:56:20.016116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013798+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:20.013798+0000","last_peered":"2024-09-15T22:56:20.013798+0000","last_clean":"2024-09-15T22:56:20.013798+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:20.013798+0000","last_undegraded":"2024-09-15T22:56:20.013798+0000","last_fullsized":"2024-09-15T22:56:20.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998090+0000","last_change":"2024-09-15T22:56:19.998090+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998090+0000","last_undegraded":"2024-09-15T22:56:19.998090+0000","last_fullsized":"2024-09-15T22:56:19.998090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030667+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:20.030667+0000","last_peered":"2024-09-15T22:56:20.030667+0000","last_clean":"2024-09-15T22:56:20.030667+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:20.030667+0000","last_undegraded":"2024-09-15T22:56:20.030667+0000","last_fullsized":"2024-09-15T22:56:20.030667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993612+0000","last_change":"2024-09-15T22:56:19.993612+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993612+0000","last_undegraded":"2024-09-15T22:56:19.993612+0000","last_fullsized":"2024-09-15T22:56:19.993612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.004782+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:20.004782+0000","last_peered":"2024-09-15T22:56:20.004782+0000","last_clean":"2024-09-15T22:56:20.004782+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:20.004782+0000","last_undegraded":"2024-09-15T22:56:20.004782+0000","last_fullsized":"2024-09-15T22:56:20.004782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.990325+0000","last_change":"2024-09-15T22:56:19.990325+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.990325+0000","last_undegraded":"2024-09-15T22:56:19.990325+0000","last_fullsized":"2024-09-15T22:56:19.990325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013524+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:20.013524+0000","last_peered":"2024-09-15T22:56:20.013524+0000","last_clean":"2024-09-15T22:56:20.013524+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:20.013524+0000","last_undegraded":"2024-09-15T22:56:20.013524+0000","last_fullsized":"2024-09-15T22:56:20.013524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984483+0000","last_change":"2024-09-15T22:56:19.984483+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984483+0000","last_undegraded":"2024-09-15T22:56:19.984483+0000","last_fullsized":"2024-09-15T22:56:19.984483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012385+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:20.012385+0000","last_peered":"2024-09-15T22:56:20.012385+0000","last_clean":"2024-09-15T22:56:20.012385+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:20.012385+0000","last_undegraded":"2024-09-15T22:56:20.012385+0000","last_fullsized":"2024-09-15T22:56:20.012385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985889+0000","last_change":"2024-09-15T22:56:19.985889+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985889+0000","last_undegraded":"2024-09-15T22:56:19.985889+0000","last_fullsized":"2024-09-15T22:56:19.985889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030746+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:20.030746+0000","last_peered":"2024-09-15T22:56:20.030746+0000","last_clean":"2024-09-15T22:56:20.030746+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:20.030746+0000","last_undegraded":"2024-09-15T22:56:20.030746+0000","last_fullsized":"2024-09-15T22:56:20.030746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988568+0000","last_change":"2024-09-15T22:56:19.988568+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988568+0000","last_undegraded":"2024-09-15T22:56:19.988568+0000","last_fullsized":"2024-09-15T22:56:19.988568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.025478+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:20.025478+0000","last_peered":"2024-09-15T22:56:20.025478+0000","last_clean":"2024-09-15T22:56:20.025478+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:20.025478+0000","last_undegraded":"2024-09-15T22:56:20.025478+0000","last_fullsized":"2024-09-15T22:56:20.025478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999525+0000","last_change":"2024-09-15T22:56:19.999525+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999525+0000","last_undegraded":"2024-09-15T22:56:19.999525+0000","last_fullsized":"2024-09-15T22:56:19.999525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028203+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:20.028203+0000","last_peered":"2024-09-15T22:56:20.028203+0000","last_clean":"2024-09-15T22:56:20.028203+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:20.028203+0000","last_undegraded":"2024-09-15T22:56:20.028203+0000","last_fullsized":"2024-09-15T22:56:20.028203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993147+0000","last_change":"2024-09-15T22:56:19.993147+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993147+0000","last_undegraded":"2024-09-15T22:56:19.993147+0000","last_fullsized":"2024-09-15T22:56:19.993147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030626+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:20.030626+0000","last_peered":"2024-09-15T22:56:20.030626+0000","last_clean":"2024-09-15T22:56:20.030626+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:20.030626+0000","last_undegraded":"2024-09-15T22:56:20.030626+0000","last_fullsized":"2024-09-15T22:56:20.030626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984127+0000","last_change":"2024-09-15T22:56:19.984127+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984127+0000","last_undegraded":"2024-09-15T22:56:19.984127+0000","last_fullsized":"2024-09-15T22:56:19.984127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.018179+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:20.018179+0000","last_peered":"2024-09-15T22:56:20.018179+0000","last_clean":"2024-09-15T22:56:20.018179+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:20.018179+0000","last_undegraded":"2024-09-15T22:56:20.018179+0000","last_fullsized":"2024-09-15T22:56:20.018179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994782+0000","last_change":"2024-09-15T22:56:19.994782+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994782+0000","last_undegraded":"2024-09-15T22:56:19.994782+0000","last_fullsized":"2024-09-15T22:56:19.994782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005945+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:20.005945+0000","last_peered":"2024-09-15T22:56:20.005945+0000","last_clean":"2024-09-15T22:56:20.005945+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:20.005945+0000","last_undegraded":"2024-09-15T22:56:20.005945+0000","last_fullsized":"2024-09-15T22:56:20.005945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001661+0000","last_change":"2024-09-15T22:56:20.001661+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001661+0000","last_undegraded":"2024-09-15T22:56:20.001661+0000","last_fullsized":"2024-09-15T22:56:20.001661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.033373+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:20.033373+0000","last_peered":"2024-09-15T22:56:20.033373+0000","last_clean":"2024-09-15T22:56:20.033373+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:20.033373+0000","last_undegraded":"2024-09-15T22:56:20.033373+0000","last_fullsized":"2024-09-15T22:56:20.033373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001960+0000","last_change":"2024-09-15T22:56:20.001960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001960+0000","last_undegraded":"2024-09-15T22:56:20.001960+0000","last_fullsized":"2024-09-15T22:56:20.001960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999146+0000","last_change":"2024-09-15T22:56:19.999146+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999146+0000","last_undegraded":"2024-09-15T22:56:19.999146+0000","last_fullsized":"2024-09-15T22:56:19.999146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030603+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:20.030603+0000","last_peered":"2024-09-15T22:56:20.030603+0000","last_clean":"2024-09-15T22:56:20.030603+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:20.030603+0000","last_undegraded":"2024-09-15T22:56:20.030603+0000","last_fullsized":"2024-09-15T22:56:20.030603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993826+0000","last_change":"2024-09-15T22:56:19.993826+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993826+0000","last_undegraded":"2024-09-15T22:56:19.993826+0000","last_fullsized":"2024-09-15T22:56:19.993826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030591+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:20.030591+0000","last_peered":"2024-09-15T22:56:20.030591+0000","last_clean":"2024-09-15T22:56:20.030591+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:20.030591+0000","last_undegraded":"2024-09-15T22:56:20.030591+0000","last_fullsized":"2024-09-15T22:56:20.030591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996479+0000","last_change":"2024-09-15T22:56:19.996479+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996479+0000","last_undegraded":"2024-09-15T22:56:19.996479+0000","last_fullsized":"2024-09-15T22:56:19.996479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012711+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:20.012711+0000","last_peered":"2024-09-15T22:56:20.012711+0000","last_clean":"2024-09-15T22:56:20.012711+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:20.012711+0000","last_undegraded":"2024-09-15T22:56:20.012711+0000","last_fullsized":"2024-09-15T22:56:20.012711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001152+0000","last_change":"2024-09-15T22:56:20.001152+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001152+0000","last_undegraded":"2024-09-15T22:56:20.001152+0000","last_fullsized":"2024-09-15T22:56:20.001152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.023491+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:20.023491+0000","last_peered":"2024-09-15T22:56:20.023491+0000","last_clean":"2024-09-15T22:56:20.023491+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:20.023491+0000","last_undegraded":"2024-09-15T22:56:20.023491+0000","last_fullsized":"2024-09-15T22:56:20.023491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:25.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:25.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 Processor -- start 2024-09-15T22:56:25.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 -- start start 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 0x7f27dc161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc06ed90 0x7f27dc15f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f27dc15f680 0x7f27dc0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f27dc15c310 con 0x7f27dc15f680 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f27dc162750 con 0x7f27dc15bf30 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e265e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc162a30 con 0x7f27dc06ed90 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f27dc15f680 0x7f27dc0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f27dc15f680 0x7f27dc0aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34454/0 (socket says 172.21.15.28:34454) 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 -- 172.21.15.28:0/2776343923 learned_addr learned my addr 172.21.15.28:0/2776343923 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27dbfff640 1 --2- 172.21.15.28:0/2776343923 >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 0x7f27dc161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 -- 172.21.15.28:0/2776343923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc06ed90 msgr2=0x7f27dc15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27db7fe640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc06ed90 0x7f27dc15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc06ed90 0x7f27dc15f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 -- 172.21.15.28:0/2776343923 >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 msgr2=0x7f27dc161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 --2- 172.21.15.28:0/2776343923 >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 0x7f27dc161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27e0bfb640 1 -- 172.21.15.28:0/2776343923 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc162d10 con 0x7f27dc15f680 2024-09-15T22:56:25.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.213+0000 7f27dbfff640 1 --2- 172.21.15.28:0/2776343923 >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 0x7f27dc161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:25.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e0bfb640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc15f680 0x7f27dc0aefa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009e50 tx=0x7f27d401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a053ab6b2c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27daffd640 1 -- 172.21.15.28:0/2776343923 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a5750 con 0x7f27dc15f680 2024-09-15T22:56:25.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27daffd640 1 -- 172.21.15.28:0/2776343923 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d40a58f0 con 0x7f27dc15f680 2024-09-15T22:56:25.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27daffd640 1 -- 172.21.15.28:0/2776343923 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a5cc0 con 0x7f27dc15f680 2024-09-15T22:56:25.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- 172.21.15.28:0/2776343923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc15f680 msgr2=0x7f27dc0aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc15f680 0x7f27dc0aefa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009e50 tx=0x7f27d401c9c0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- 172.21.15.28:0/2776343923 shutdown_connections 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc15f680 0x7f27dc0aefa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 --2- 172.21.15.28:0/2776343923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc06ed90 0x7f27dc15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 --2- 172.21.15.28:0/2776343923 >> v2:172.21.15.131:3300/0 conn(0x7f27dc15bf30 0x7f27dc161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- 172.21.15.28:0/2776343923 >> 172.21.15.28:0/2776343923 conn(0x7f27dc067a00 msgr2=0x7f27dc067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- 172.21.15.28:0/2776343923 shutdown_connections 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- 172.21.15.28:0/2776343923 wait complete. 2024-09-15T22:56:25.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 Processor -- start 2024-09-15T22:56:25.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.217+0000 7f27e265e640 1 -- start start 2024-09-15T22:56:25.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc15bf30 0x7f27dc072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 0x7f27dc1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0b4df0 con 0x7f27dc06ed90 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0b4c70 con 0x7f27dc15f680 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc0b2f40 con 0x7f27dc15bf30 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34468/0 (socket says 172.21.15.28:34468) 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 -- 172.21.15.28:0/945357174 learned_addr learned my addr 172.21.15.28:0/945357174 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 -- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc15bf30 msgr2=0x7f27dc072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc15bf30 0x7f27dc072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 -- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 msgr2=0x7f27dc1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e0bfb640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 0x7f27dc1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 0x7f27dc1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 -- 172.21.15.28:0/945357174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc151cd0 con 0x7f27dc06ed90 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e0bfb640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 0x7f27dc1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27dbfff640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00c7c0 tx=0x7f27cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc007a30 con 0x7f27dc06ed90 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc007bd0 con 0x7f27dc06ed90 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27dc151fb0 con 0x7f27dc06ed90 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0113f0 con 0x7f27dc06ed90 2024-09-15T22:56:25.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27dc152570 con 0x7f27dc06ed90 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27dc161f00 con 0x7f27dc06ed90 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27cc011590 con 0x7f27dc06ed90 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 0x7f27bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27cc085ec0 con 0x7f27dc06ed90 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27db7fe640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 0x7f27bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.221+0000 7f27db7fe640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 0x7f27bc069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27dc15e750 tx=0x7f27c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.225+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f27cc015020 con 0x7f27dc06ed90 2024-09-15T22:56:25.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.385+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27dc1579c0 con 0x7f27bc0678c0 2024-09-15T22:56:25.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.401+0000 7f27d8ff9640 1 -- 172.21.15.28:0/945357174 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246629 (secure 0 0 0) 0x7f27dc1579c0 con 0x7f27bc0678c0 2024-09-15T22:56:25.406 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:25.407 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 msgr2=0x7f27bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 0x7f27bc069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27dc15e750 tx=0x7f27c4008040 comp rx=0 tx=0).stop 2024-09-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 msgr2=0x7f27dc151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00c7c0 tx=0x7f27cc00cc80 comp rx=0 tx=0).stop 2024-09-15T22:56:25.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 shutdown_connections 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f27bc0678c0 0x7f27bc069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27dc15f680 0x7f27dc1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27dc15bf30 0x7f27dc072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 --2- 172.21.15.28:0/945357174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27dc06ed90 0x7f27dc151220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 >> 172.21.15.28:0/945357174 conn(0x7f27dc067a00 msgr2=0x7f27dc157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 shutdown_connections 2024-09-15T22:56:25.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.405+0000 7f27e265e640 1 -- 172.21.15.28:0/945357174 wait complete. 2024-09-15T22:56:25.425 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-15T22:56:23.867475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235352,"kb_used_data":2484,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739368,"statfs":{"total":773094113280,"available":772853112832,"internally_reserved":0,"allocated":2543616,"data_stored":1599683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999967+0000","last_change":"2024-09-15T22:56:19.999967+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999967+0000","last_undegraded":"2024-09-15T22:56:19.999967+0000","last_fullsized":"2024-09-15T22:56:19.999967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989863+0000","last_change":"2024-09-15T22:56:19.989863+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989863+0000","last_undegraded":"2024-09-15T22:56:19.989863+0000","last_fullsized":"2024-09-15T22:56:19.989863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992776+0000","last_change":"2024-09-15T22:56:19.992776+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992776+0000","last_undegraded":"2024-09-15T22:56:19.992776+0000","last_fullsized":"2024-09-15T22:56:19.992776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994974+0000","last_change":"2024-09-15T22:56:19.994974+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994974+0000","last_undegraded":"2024-09-15T22:56:19.994974+0000","last_fullsized":"2024-09-15T22:56:19.994974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992877+0000","last_change":"2024-09-15T22:56:19.992877+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992877+0000","last_undegraded":"2024-09-15T22:56:19.992877+0000","last_fullsized":"2024-09-15T22:56:19.992877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999894+0000","last_change":"2024-09-15T22:56:19.999894+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999894+0000","last_undegraded":"2024-09-15T22:56:19.999894+0000","last_fullsized":"2024-09-15T22:56:19.999894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994033+0000","last_change":"2024-09-15T22:56:19.994033+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994033+0000","last_undegraded":"2024-09-15T22:56:19.994033+0000","last_fullsized":"2024-09-15T22:56:19.994033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998038+0000","last_change":"2024-09-15T22:56:19.998038+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998038+0000","last_undegraded":"2024-09-15T22:56:19.998038+0000","last_fullsized":"2024-09-15T22:56:19.998038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995462+0000","last_change":"2024-09-15T22:56:19.995462+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995462+0000","last_undegraded":"2024-09-15T22:56:19.995462+0000","last_fullsized":"2024-09-15T22:56:19.995462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014944+0000","last_change":"2024-09-15T22:56:20.014944+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014944+0000","last_undegraded":"2024-09-15T22:56:20.014944+0000","last_fullsized":"2024-09-15T22:56:20.014944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991946+0000","last_change":"2024-09-15T22:56:19.991946+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991946+0000","last_undegraded":"2024-09-15T22:56:19.991946+0000","last_fullsized":"2024-09-15T22:56:19.991946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988652+0000","last_change":"2024-09-15T22:56:19.988652+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988652+0000","last_undegraded":"2024-09-15T22:56:19.988652+0000","last_fullsized":"2024-09-15T22:56:19.988652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.002453+0000","last_change":"2024-09-15T22:56:20.002453+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.002453+0000","last_undegraded":"2024-09-15T22:56:20.002453+0000","last_fullsized":"2024-09-15T22:56:20.002453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999827+0000","last_change":"2024-09-15T22:56:19.999827+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999827+0000","last_undegraded":"2024-09-15T22:56:19.999827+0000","last_fullsized":"2024-09-15T22:56:19.999827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989752+0000","last_change":"2024-09-15T22:56:19.989752+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989752+0000","last_undegraded":"2024-09-15T22:56:19.989752+0000","last_fullsized":"2024-09-15T22:56:19.989752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993848+0000","last_change":"2024-09-15T22:56:19.993848+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993848+0000","last_undegraded":"2024-09-15T22:56:19.993848+0000","last_fullsized":"2024-09-15T22:56:19.993848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.986296+0000","last_change":"2024-09-15T22:56:19.986296+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.986296+0000","last_undegraded":"2024-09-15T22:56:19.986296+0000","last_fullsized":"2024-09-15T22:56:19.986296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987524+0000","last_change":"2024-09-15T22:56:19.987524+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987524+0000","last_undegraded":"2024-09-15T22:56:19.987524+0000","last_fullsized":"2024-09-15T22:56:19.987524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006588+0000","last_change":"2024-09-15T22:56:20.006588+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006588+0000","last_undegraded":"2024-09-15T22:56:20.006588+0000","last_fullsized":"2024-09-15T22:56:20.006588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993379+0000","last_change":"2024-09-15T22:56:19.993379+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993379+0000","last_undegraded":"2024-09-15T22:56:19.993379+0000","last_fullsized":"2024-09-15T22:56:19.993379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007240+0000","last_change":"2024-09-15T22:56:20.007240+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007240+0000","last_undegraded":"2024-09-15T22:56:20.007240+0000","last_fullsized":"2024-09-15T22:56:20.007240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998141+0000","last_change":"2024-09-15T22:56:19.998141+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998141+0000","last_undegraded":"2024-09-15T22:56:19.998141+0000","last_fullsized":"2024-09-15T22:56:19.998141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.997311+0000","last_change":"2024-09-15T22:56:19.997311+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.997311+0000","last_undegraded":"2024-09-15T22:56:19.997311+0000","last_fullsized":"2024-09-15T22:56:19.997311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987655+0000","last_change":"2024-09-15T22:56:19.987655+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987655+0000","last_undegraded":"2024-09-15T22:56:19.987655+0000","last_fullsized":"2024-09-15T22:56:19.987655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.000313+0000","last_change":"2024-09-15T22:56:20.000313+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.000313+0000","last_undegraded":"2024-09-15T22:56:20.000313+0000","last_fullsized":"2024-09-15T22:56:20.000313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.005100+0000","last_change":"2024-09-15T22:56:20.005100+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.005100+0000","last_undegraded":"2024-09-15T22:56:20.005100+0000","last_fullsized":"2024-09-15T22:56:20.005100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988951+0000","last_change":"2024-09-15T22:56:19.988951+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988951+0000","last_undegraded":"2024-09-15T22:56:19.988951+0000","last_fullsized":"2024-09-15T22:56:19.988951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996166+0000","last_change":"2024-09-15T22:56:19.996166+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996166+0000","last_undegraded":"2024-09-15T22:56:19.996166+0000","last_fullsized":"2024-09-15T22:56:19.996166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006410+0000","last_change":"2024-09-15T22:56:20.006410+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006410+0000","last_undegraded":"2024-09-15T22:56:20.006410+0000","last_fullsized":"2024-09-15T22:56:20.006410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995991+0000","last_change":"2024-09-15T22:56:19.995991+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995991+0000","last_undegraded":"2024-09-15T22:56:19.995991+0000","last_fullsized":"2024-09-15T22:56:19.995991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987212+0000","last_change":"2024-09-15T22:56:19.987212+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987212+0000","last_undegraded":"2024-09-15T22:56:19.987212+0000","last_fullsized":"2024-09-15T22:56:19.987212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998605+0000","last_change":"2024-09-15T22:56:19.998605+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998605+0000","last_undegraded":"2024-09-15T22:56:19.998605+0000","last_fullsized":"2024-09-15T22:56:19.998605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985845+0000","last_change":"2024-09-15T22:56:19.985845+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985845+0000","last_undegraded":"2024-09-15T22:56:19.985845+0000","last_fullsized":"2024-09-15T22:56:19.985845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.020639+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:20.020639+0000","last_peered":"2024-09-15T22:56:20.020639+0000","last_clean":"2024-09-15T22:56:20.020639+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:20.020639+0000","last_undegraded":"2024-09-15T22:56:20.020639+0000","last_fullsized":"2024-09-15T22:56:20.020639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994960+0000","last_change":"2024-09-15T22:56:19.994960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994960+0000","last_undegraded":"2024-09-15T22:56:19.994960+0000","last_fullsized":"2024-09-15T22:56:19.994960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028259+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:20.028259+0000","last_peered":"2024-09-15T22:56:20.028259+0000","last_clean":"2024-09-15T22:56:20.028259+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:20.028259+0000","last_undegraded":"2024-09-15T22:56:20.028259+0000","last_fullsized":"2024-09-15T22:56:20.028259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027496+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:20.027496+0000","last_peered":"2024-09-15T22:56:20.027496+0000","last_clean":"2024-09-15T22:56:20.027496+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:20.027496+0000","last_undegraded":"2024-09-15T22:56:20.027496+0000","last_fullsized":"2024-09-15T22:56:20.027496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996831+0000","last_change":"2024-09-15T22:56:19.996831+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996831+0000","last_undegraded":"2024-09-15T22:56:19.996831+0000","last_fullsized":"2024-09-15T22:56:19.996831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012753+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:20.012753+0000","last_peered":"2024-09-15T22:56:20.012753+0000","last_clean":"2024-09-15T22:56:20.012753+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:20.012753+0000","last_undegraded":"2024-09-15T22:56:20.012753+0000","last_fullsized":"2024-09-15T22:56:20.012753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:15.954127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988501+0000","last_change":"2024-09-15T22:56:19.988501+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988501+0000","last_undegraded":"2024-09-15T22:56:19.988501+0000","last_fullsized":"2024-09-15T22:56:19.988501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027968+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:20.027968+0000","last_peered":"2024-09-15T22:56:20.027968+0000","last_clean":"2024-09-15T22:56:20.027968+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:20.027968+0000","last_undegraded":"2024-09-15T22:56:20.027968+0000","last_fullsized":"2024-09-15T22:56:20.027968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987423+0000","last_change":"2024-09-15T22:56:19.987423+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987423+0000","last_undegraded":"2024-09-15T22:56:19.987423+0000","last_fullsized":"2024-09-15T22:56:19.987423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028178+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:20.028178+0000","last_peered":"2024-09-15T22:56:20.028178+0000","last_clean":"2024-09-15T22:56:20.028178+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:20.028178+0000","last_undegraded":"2024-09-15T22:56:20.028178+0000","last_fullsized":"2024-09-15T22:56:20.028178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995682+0000","last_change":"2024-09-15T22:56:19.995682+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995682+0000","last_undegraded":"2024-09-15T22:56:19.995682+0000","last_fullsized":"2024-09-15T22:56:19.995682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016489+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:20.016489+0000","last_peered":"2024-09-15T22:56:20.016489+0000","last_clean":"2024-09-15T22:56:20.016489+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:20.016489+0000","last_undegraded":"2024-09-15T22:56:20.016489+0000","last_fullsized":"2024-09-15T22:56:20.016489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.983761+0000","last_change":"2024-09-15T22:56:19.983761+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.983761+0000","last_undegraded":"2024-09-15T22:56:19.983761+0000","last_fullsized":"2024-09-15T22:56:19.983761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028294+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:20.028294+0000","last_peered":"2024-09-15T22:56:20.028294+0000","last_clean":"2024-09-15T22:56:20.028294+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:20.028294+0000","last_undegraded":"2024-09-15T22:56:20.028294+0000","last_fullsized":"2024-09-15T22:56:20.028294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014809+0000","last_change":"2024-09-15T22:56:20.014809+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014809+0000","last_undegraded":"2024-09-15T22:56:20.014809+0000","last_fullsized":"2024-09-15T22:56:20.014809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012371+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:20.012371+0000","last_peered":"2024-09-15T22:56:20.012371+0000","last_clean":"2024-09-15T22:56:20.012371+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:20.012371+0000","last_undegraded":"2024-09-15T22:56:20.012371+0000","last_fullsized":"2024-09-15T22:56:20.012371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992292+0000","last_change":"2024-09-15T22:56:19.992292+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992292+0000","last_undegraded":"2024-09-15T22:56:19.992292+0000","last_fullsized":"2024-09-15T22:56:19.992292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013872+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:20.013872+0000","last_peered":"2024-09-15T22:56:20.013872+0000","last_clean":"2024-09-15T22:56:20.013872+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:20.013872+0000","last_undegraded":"2024-09-15T22:56:20.013872+0000","last_fullsized":"2024-09-15T22:56:20.013872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991128+0000","last_change":"2024-09-15T22:56:19.991128+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991128+0000","last_undegraded":"2024-09-15T22:56:19.991128+0000","last_fullsized":"2024-09-15T22:56:19.991128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028302+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:20.028302+0000","last_peered":"2024-09-15T22:56:20.028302+0000","last_clean":"2024-09-15T22:56:20.028302+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:20.028302+0000","last_undegraded":"2024-09-15T22:56:20.028302+0000","last_fullsized":"2024-09-15T22:56:20.028302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992976+0000","last_change":"2024-09-15T22:56:19.992976+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992976+0000","last_undegraded":"2024-09-15T22:56:19.992976+0000","last_fullsized":"2024-09-15T22:56:19.992976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:19.995842+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:19.995842+0000","last_peered":"2024-09-15T22:56:19.995842+0000","last_clean":"2024-09-15T22:56:19.995842+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:19.995842+0000","last_undegraded":"2024-09-15T22:56:19.995842+0000","last_fullsized":"2024-09-15T22:56:19.995842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992162+0000","last_change":"2024-09-15T22:56:19.992162+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992162+0000","last_undegraded":"2024-09-15T22:56:19.992162+0000","last_fullsized":"2024-09-15T22:56:19.992162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.014348+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:20.014348+0000","last_peered":"2024-09-15T22:56:20.014348+0000","last_clean":"2024-09-15T22:56:20.014348+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:20.014348+0000","last_undegraded":"2024-09-15T22:56:20.014348+0000","last_fullsized":"2024-09-15T22:56:20.014348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991190+0000","last_change":"2024-09-15T22:56:19.991190+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991190+0000","last_undegraded":"2024-09-15T22:56:19.991190+0000","last_fullsized":"2024-09-15T22:56:19.991190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.010908+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:20.010908+0000","last_peered":"2024-09-15T22:56:20.010908+0000","last_clean":"2024-09-15T22:56:20.010908+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:20.010908+0000","last_undegraded":"2024-09-15T22:56:20.010908+0000","last_fullsized":"2024-09-15T22:56:20.010908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994660+0000","last_change":"2024-09-15T22:56:19.994660+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994660+0000","last_undegraded":"2024-09-15T22:56:19.994660+0000","last_fullsized":"2024-09-15T22:56:19.994660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005340+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:20.005340+0000","last_peered":"2024-09-15T22:56:20.005340+0000","last_clean":"2024-09-15T22:56:20.005340+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:20.005340+0000","last_undegraded":"2024-09-15T22:56:20.005340+0000","last_fullsized":"2024-09-15T22:56:20.005340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991249+0000","last_change":"2024-09-15T22:56:19.991249+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991249+0000","last_undegraded":"2024-09-15T22:56:19.991249+0000","last_fullsized":"2024-09-15T22:56:19.991249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.009183+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:20.009183+0000","last_peered":"2024-09-15T22:56:20.009183+0000","last_clean":"2024-09-15T22:56:20.009183+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:20.009183+0000","last_undegraded":"2024-09-15T22:56:20.009183+0000","last_fullsized":"2024-09-15T22:56:20.009183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007677+0000","last_change":"2024-09-15T22:56:20.007677+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007677+0000","last_undegraded":"2024-09-15T22:56:20.007677+0000","last_fullsized":"2024-09-15T22:56:20.007677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016116+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:20.016116+0000","last_peered":"2024-09-15T22:56:20.016116+0000","last_clean":"2024-09-15T22:56:20.016116+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:20.016116+0000","last_undegraded":"2024-09-15T22:56:20.016116+0000","last_fullsized":"2024-09-15T22:56:20.016116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013798+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:20.013798+0000","last_peered":"2024-09-15T22:56:20.013798+0000","last_clean":"2024-09-15T22:56:20.013798+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:20.013798+0000","last_undegraded":"2024-09-15T22:56:20.013798+0000","last_fullsized":"2024-09-15T22:56:20.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998090+0000","last_change":"2024-09-15T22:56:19.998090+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998090+0000","last_undegraded":"2024-09-15T22:56:19.998090+0000","last_fullsized":"2024-09-15T22:56:19.998090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030667+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:20.030667+0000","last_peered":"2024-09-15T22:56:20.030667+0000","last_clean":"2024-09-15T22:56:20.030667+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:20.030667+0000","last_undegraded":"2024-09-15T22:56:20.030667+0000","last_fullsized":"2024-09-15T22:56:20.030667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993612+0000","last_change":"2024-09-15T22:56:19.993612+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993612+0000","last_undegraded":"2024-09-15T22:56:19.993612+0000","last_fullsized":"2024-09-15T22:56:19.993612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.004782+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:20.004782+0000","last_peered":"2024-09-15T22:56:20.004782+0000","last_clean":"2024-09-15T22:56:20.004782+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:20.004782+0000","last_undegraded":"2024-09-15T22:56:20.004782+0000","last_fullsized":"2024-09-15T22:56:20.004782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.990325+0000","last_change":"2024-09-15T22:56:19.990325+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.990325+0000","last_undegraded":"2024-09-15T22:56:19.990325+0000","last_fullsized":"2024-09-15T22:56:19.990325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013524+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:20.013524+0000","last_peered":"2024-09-15T22:56:20.013524+0000","last_clean":"2024-09-15T22:56:20.013524+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:20.013524+0000","last_undegraded":"2024-09-15T22:56:20.013524+0000","last_fullsized":"2024-09-15T22:56:20.013524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984483+0000","last_change":"2024-09-15T22:56:19.984483+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984483+0000","last_undegraded":"2024-09-15T22:56:19.984483+0000","last_fullsized":"2024-09-15T22:56:19.984483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012385+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:20.012385+0000","last_peered":"2024-09-15T22:56:20.012385+0000","last_clean":"2024-09-15T22:56:20.012385+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:20.012385+0000","last_undegraded":"2024-09-15T22:56:20.012385+0000","last_fullsized":"2024-09-15T22:56:20.012385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985889+0000","last_change":"2024-09-15T22:56:19.985889+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985889+0000","last_undegraded":"2024-09-15T22:56:19.985889+0000","last_fullsized":"2024-09-15T22:56:19.985889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030746+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:20.030746+0000","last_peered":"2024-09-15T22:56:20.030746+0000","last_clean":"2024-09-15T22:56:20.030746+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:20.030746+0000","last_undegraded":"2024-09-15T22:56:20.030746+0000","last_fullsized":"2024-09-15T22:56:20.030746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988568+0000","last_change":"2024-09-15T22:56:19.988568+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988568+0000","last_undegraded":"2024-09-15T22:56:19.988568+0000","last_fullsized":"2024-09-15T22:56:19.988568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.025478+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:20.025478+0000","last_peered":"2024-09-15T22:56:20.025478+0000","last_clean":"2024-09-15T22:56:20.025478+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:20.025478+0000","last_undegraded":"2024-09-15T22:56:20.025478+0000","last_fullsized":"2024-09-15T22:56:20.025478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999525+0000","last_change":"2024-09-15T22:56:19.999525+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999525+0000","last_undegraded":"2024-09-15T22:56:19.999525+0000","last_fullsized":"2024-09-15T22:56:19.999525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028203+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:20.028203+0000","last_peered":"2024-09-15T22:56:20.028203+0000","last_clean":"2024-09-15T22:56:20.028203+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:20.028203+0000","last_undegraded":"2024-09-15T22:56:20.028203+0000","last_fullsized":"2024-09-15T22:56:20.028203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993147+0000","last_change":"2024-09-15T22:56:19.993147+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993147+0000","last_undegraded":"2024-09-15T22:56:19.993147+0000","last_fullsized":"2024-09-15T22:56:19.993147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030626+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:20.030626+0000","last_peered":"2024-09-15T22:56:20.030626+0000","last_clean":"2024-09-15T22:56:20.030626+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:20.030626+0000","last_undegraded":"2024-09-15T22:56:20.030626+0000","last_fullsized":"2024-09-15T22:56:20.030626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984127+0000","last_change":"2024-09-15T22:56:19.984127+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984127+0000","last_undegraded":"2024-09-15T22:56:19.984127+0000","last_fullsized":"2024-09-15T22:56:19.984127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.018179+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:20.018179+0000","last_peered":"2024-09-15T22:56:20.018179+0000","last_clean":"2024-09-15T22:56:20.018179+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:20.018179+0000","last_undegraded":"2024-09-15T22:56:20.018179+0000","last_fullsized":"2024-09-15T22:56:20.018179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994782+0000","last_change":"2024-09-15T22:56:19.994782+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994782+0000","last_undegraded":"2024-09-15T22:56:19.994782+0000","last_fullsized":"2024-09-15T22:56:19.994782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005945+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:20.005945+0000","last_peered":"2024-09-15T22:56:20.005945+0000","last_clean":"2024-09-15T22:56:20.005945+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:20.005945+0000","last_undegraded":"2024-09-15T22:56:20.005945+0000","last_fullsized":"2024-09-15T22:56:20.005945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001661+0000","last_change":"2024-09-15T22:56:20.001661+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001661+0000","last_undegraded":"2024-09-15T22:56:20.001661+0000","last_fullsized":"2024-09-15T22:56:20.001661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.033373+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:20.033373+0000","last_peered":"2024-09-15T22:56:20.033373+0000","last_clean":"2024-09-15T22:56:20.033373+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:20.033373+0000","last_undegraded":"2024-09-15T22:56:20.033373+0000","last_fullsized":"2024-09-15T22:56:20.033373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001960+0000","last_change":"2024-09-15T22:56:20.001960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001960+0000","last_undegraded":"2024-09-15T22:56:20.001960+0000","last_fullsized":"2024-09-15T22:56:20.001960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999146+0000","last_change":"2024-09-15T22:56:19.999146+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999146+0000","last_undegraded":"2024-09-15T22:56:19.999146+0000","last_fullsized":"2024-09-15T22:56:19.999146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030603+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:20.030603+0000","last_peered":"2024-09-15T22:56:20.030603+0000","last_clean":"2024-09-15T22:56:20.030603+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:20.030603+0000","last_undegraded":"2024-09-15T22:56:20.030603+0000","last_fullsized":"2024-09-15T22:56:20.030603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993826+0000","last_change":"2024-09-15T22:56:19.993826+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993826+0000","last_undegraded":"2024-09-15T22:56:19.993826+0000","last_fullsized":"2024-09-15T22:56:19.993826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030591+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:20.030591+0000","last_peered":"2024-09-15T22:56:20.030591+0000","last_clean":"2024-09-15T22:56:20.030591+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:20.030591+0000","last_undegraded":"2024-09-15T22:56:20.030591+0000","last_fullsized":"2024-09-15T22:56:20.030591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996479+0000","last_change":"2024-09-15T22:56:19.996479+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996479+0000","last_undegraded":"2024-09-15T22:56:19.996479+0000","last_fullsized":"2024-09-15T22:56:19.996479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012711+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:20.012711+0000","last_peered":"2024-09-15T22:56:20.012711+0000","last_clean":"2024-09-15T22:56:20.012711+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:20.012711+0000","last_undegraded":"2024-09-15T22:56:20.012711+0000","last_fullsized":"2024-09-15T22:56:20.012711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001152+0000","last_change":"2024-09-15T22:56:20.001152+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001152+0000","last_undegraded":"2024-09-15T22:56:20.001152+0000","last_fullsized":"2024-09-15T22:56:20.001152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.023491+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:20.023491+0000","last_peered":"2024-09-15T22:56:20.023491+0000","last_clean":"2024-09-15T22:56:20.023491+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:20.023491+0000","last_undegraded":"2024-09-15T22:56:20.023491+0000","last_fullsized":"2024-09-15T22:56:20.023491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:25.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 Processor -- start 2024-09-15T22:56:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 -- start start 2024-09-15T22:56:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f554815e910 0x7f554815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55480b4460 con 0x7f554815bf10 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554815c2f0 con 0x7f55480b4ee0 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554f873640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f554815f3d0 con 0x7f554815e910 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554d60f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f554815bf10 0x7f5548072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44942/0 (socket says 172.21.15.28:44942) 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554d60f640 1 -- 172.21.15.28:0/197209683 learned_addr learned my addr 172.21.15.28:0/197209683 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76258349 0 0) 0x7f5544001120 con 0x7f554815bf10 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5534003530 con 0x7f554815bf10 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> v2:172.21.15.131:3300/0 conn(0x7f554815e910 0x7f554815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 806727283 0 0) 0x7f5534003530 con 0x7f554815bf10 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 >> v2:172.21.15.131:3300/0 conn(0x7f554815e910 msgr2=0x7f554815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 --2- 172.21.15.28:0/197209683 >> v2:172.21.15.131:3300/0 conn(0x7f554815e910 0x7f554815ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 >> v1:172.21.15.131:6789/0 conn(0x7f55480b4ee0 legacy=0x7f55480b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554815f6b0 con 0x7f554815bf10 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f5544001850 con 0x7f554815bf10 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> v2:172.21.15.131:3300/0 conn(0x7f554815e910 0x7f554815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 >> v1:172.21.15.28:6789/0 conn(0x7f554815bf10 legacy=0x7f5548072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340039c0 0x7f5534003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 0x7f5534004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55340051d0 0x7f553400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f554815f3d0 con 0x7f5534004810 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f553400c120 con 0x7f55340051d0 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f553400c320 con 0x7f55340039c0 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 0x7f5534004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554d60f640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340039c0 0x7f5534003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 -- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340039c0 msgr2=0x7f5534003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340039c0 0x7f5534003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 -- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55340051d0 msgr2=0x7f553400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554de10640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55340051d0 0x7f553400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55340051d0 0x7f553400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554de10640 1 -- 172.21.15.28:0/197209683 reap_dead start 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554ce0e640 1 -- 172.21.15.28:0/197209683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534003530 con 0x7f5534004810 2024-09-15T22:56:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.597+0000 7f554d60f640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55340039c0 0x7f5534003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554ce0e640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 0x7f5534004c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f55380098d0 tx=0x7f553801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ce704b49268006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553800f040 con 0x7f5534004810 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380af070 con 0x7f5534004810 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f553ffff640 1 -- 172.21.15.28:0/197209683 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380aa870 con 0x7f5534004810 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 msgr2=0x7f5534004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 0x7f5534004c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f55380098d0 tx=0x7f553801c5d0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- 172.21.15.28:0/197209683 shutdown_connections 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 --2- 172.21.15.28:0/197209683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5534004810 0x7f5534004c90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- 172.21.15.28:0/197209683 >> 172.21.15.28:0/197209683 conn(0x7f5548067a00 msgr2=0x7f5548067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- 172.21.15.28:0/197209683 shutdown_connections 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- 172.21.15.28:0/197209683 wait complete. 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 Processor -- start 2024-09-15T22:56:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- start start 2024-09-15T22:56:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5534004810 0x7f55481e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5548158e20 0x7f55480b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55480af160 con 0x7f55481e96d0 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f55480b49c0 con 0x7f5548158e20 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.601+0000 7f554f873640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f55480af2e0 con 0x7f5534004810 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34486/0 (socket says 172.21.15.28:34486) 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 -- 172.21.15.28:0/165067517 learned_addr learned my addr 172.21.15.28:0/165067517 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554de10640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5548158e20 0x7f55480b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554d60f640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5534004810 0x7f55481e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 -- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5534004810 msgr2=0x7f55481e9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5534004810 0x7f55481e9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 -- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5548158e20 msgr2=0x7f55480b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5548158e20 0x7f55480b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 -- 172.21.15.28:0/165067517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55481e86d0 con 0x7f55481e96d0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554ce0e640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f553801c400 tx=0x7f5534005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380c1070 con 0x7f55481e96d0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380aab70 con 0x7f55481e96d0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55480c6fa0 con 0x7f55481e96d0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380bc410 con 0x7f55481e96d0 2024-09-15T22:56:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481e8c50 con 0x7f55481e96d0 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554814d280 con 0x7f55481e96d0 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55380c4070 con 0x7f55481e96d0 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 0x7f552c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f553811fbb0 con 0x7f55481e96d0 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554d60f640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 0x7f552c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.605+0000 7f554d60f640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 0x7f552c069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55440019c0 tx=0x7f5544001120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.609+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55380162e0 con 0x7f55481e96d0 2024-09-15T22:56:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.769+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55480af800 con 0x7f552c0678f0 2024-09-15T22:56:25.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.785+0000 7f553dffb640 1 -- 172.21.15.28:0/165067517 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246629 (secure 0 0 0) 0x7f55480af800 con 0x7f552c0678f0 2024-09-15T22:56:25.790 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:25.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 msgr2=0x7f552c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 0x7f552c069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55440019c0 tx=0x7f5544001120 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 msgr2=0x7f554814cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f553801c400 tx=0x7f5534005840 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 shutdown_connections 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f552c0678f0 0x7f552c069db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5548158e20 0x7f55480b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55481e96d0 0x7f554814cce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 --2- 172.21.15.28:0/165067517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5534004810 0x7f55481e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 >> 172.21.15.28:0/165067517 conn(0x7f5548067a00 msgr2=0x7f55481613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 shutdown_connections 2024-09-15T22:56:25.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.789+0000 7f554f873640 1 -- 172.21.15.28:0/165067517 wait complete. 2024-09-15T22:56:25.809 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-15T22:56:23.867475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235352,"kb_used_data":2484,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739368,"statfs":{"total":773094113280,"available":772853112832,"internally_reserved":0,"allocated":2543616,"data_stored":1599683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999967+0000","last_change":"2024-09-15T22:56:19.999967+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999967+0000","last_undegraded":"2024-09-15T22:56:19.999967+0000","last_fullsized":"2024-09-15T22:56:19.999967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989863+0000","last_change":"2024-09-15T22:56:19.989863+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989863+0000","last_undegraded":"2024-09-15T22:56:19.989863+0000","last_fullsized":"2024-09-15T22:56:19.989863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992776+0000","last_change":"2024-09-15T22:56:19.992776+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992776+0000","last_undegraded":"2024-09-15T22:56:19.992776+0000","last_fullsized":"2024-09-15T22:56:19.992776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994974+0000","last_change":"2024-09-15T22:56:19.994974+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994974+0000","last_undegraded":"2024-09-15T22:56:19.994974+0000","last_fullsized":"2024-09-15T22:56:19.994974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992877+0000","last_change":"2024-09-15T22:56:19.992877+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992877+0000","last_undegraded":"2024-09-15T22:56:19.992877+0000","last_fullsized":"2024-09-15T22:56:19.992877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999894+0000","last_change":"2024-09-15T22:56:19.999894+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999894+0000","last_undegraded":"2024-09-15T22:56:19.999894+0000","last_fullsized":"2024-09-15T22:56:19.999894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994033+0000","last_change":"2024-09-15T22:56:19.994033+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994033+0000","last_undegraded":"2024-09-15T22:56:19.994033+0000","last_fullsized":"2024-09-15T22:56:19.994033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998038+0000","last_change":"2024-09-15T22:56:19.998038+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998038+0000","last_undegraded":"2024-09-15T22:56:19.998038+0000","last_fullsized":"2024-09-15T22:56:19.998038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995462+0000","last_change":"2024-09-15T22:56:19.995462+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995462+0000","last_undegraded":"2024-09-15T22:56:19.995462+0000","last_fullsized":"2024-09-15T22:56:19.995462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014944+0000","last_change":"2024-09-15T22:56:20.014944+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014944+0000","last_undegraded":"2024-09-15T22:56:20.014944+0000","last_fullsized":"2024-09-15T22:56:20.014944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991946+0000","last_change":"2024-09-15T22:56:19.991946+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991946+0000","last_undegraded":"2024-09-15T22:56:19.991946+0000","last_fullsized":"2024-09-15T22:56:19.991946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988652+0000","last_change":"2024-09-15T22:56:19.988652+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988652+0000","last_undegraded":"2024-09-15T22:56:19.988652+0000","last_fullsized":"2024-09-15T22:56:19.988652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.002453+0000","last_change":"2024-09-15T22:56:20.002453+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.002453+0000","last_undegraded":"2024-09-15T22:56:20.002453+0000","last_fullsized":"2024-09-15T22:56:20.002453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999827+0000","last_change":"2024-09-15T22:56:19.999827+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999827+0000","last_undegraded":"2024-09-15T22:56:19.999827+0000","last_fullsized":"2024-09-15T22:56:19.999827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.989752+0000","last_change":"2024-09-15T22:56:19.989752+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.989752+0000","last_undegraded":"2024-09-15T22:56:19.989752+0000","last_fullsized":"2024-09-15T22:56:19.989752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993848+0000","last_change":"2024-09-15T22:56:19.993848+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993848+0000","last_undegraded":"2024-09-15T22:56:19.993848+0000","last_fullsized":"2024-09-15T22:56:19.993848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.986296+0000","last_change":"2024-09-15T22:56:19.986296+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.986296+0000","last_undegraded":"2024-09-15T22:56:19.986296+0000","last_fullsized":"2024-09-15T22:56:19.986296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987524+0000","last_change":"2024-09-15T22:56:19.987524+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987524+0000","last_undegraded":"2024-09-15T22:56:19.987524+0000","last_fullsized":"2024-09-15T22:56:19.987524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006588+0000","last_change":"2024-09-15T22:56:20.006588+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006588+0000","last_undegraded":"2024-09-15T22:56:20.006588+0000","last_fullsized":"2024-09-15T22:56:20.006588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993379+0000","last_change":"2024-09-15T22:56:19.993379+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993379+0000","last_undegraded":"2024-09-15T22:56:19.993379+0000","last_fullsized":"2024-09-15T22:56:19.993379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007240+0000","last_change":"2024-09-15T22:56:20.007240+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007240+0000","last_undegraded":"2024-09-15T22:56:20.007240+0000","last_fullsized":"2024-09-15T22:56:20.007240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998141+0000","last_change":"2024-09-15T22:56:19.998141+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998141+0000","last_undegraded":"2024-09-15T22:56:19.998141+0000","last_fullsized":"2024-09-15T22:56:19.998141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.997311+0000","last_change":"2024-09-15T22:56:19.997311+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.997311+0000","last_undegraded":"2024-09-15T22:56:19.997311+0000","last_fullsized":"2024-09-15T22:56:19.997311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987655+0000","last_change":"2024-09-15T22:56:19.987655+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987655+0000","last_undegraded":"2024-09-15T22:56:19.987655+0000","last_fullsized":"2024-09-15T22:56:19.987655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.000313+0000","last_change":"2024-09-15T22:56:20.000313+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.000313+0000","last_undegraded":"2024-09-15T22:56:20.000313+0000","last_fullsized":"2024-09-15T22:56:20.000313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.005100+0000","last_change":"2024-09-15T22:56:20.005100+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.005100+0000","last_undegraded":"2024-09-15T22:56:20.005100+0000","last_fullsized":"2024-09-15T22:56:20.005100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988951+0000","last_change":"2024-09-15T22:56:19.988951+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988951+0000","last_undegraded":"2024-09-15T22:56:19.988951+0000","last_fullsized":"2024-09-15T22:56:19.988951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996166+0000","last_change":"2024-09-15T22:56:19.996166+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996166+0000","last_undegraded":"2024-09-15T22:56:19.996166+0000","last_fullsized":"2024-09-15T22:56:19.996166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.006410+0000","last_change":"2024-09-15T22:56:20.006410+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.006410+0000","last_undegraded":"2024-09-15T22:56:20.006410+0000","last_fullsized":"2024-09-15T22:56:20.006410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995991+0000","last_change":"2024-09-15T22:56:19.995991+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995991+0000","last_undegraded":"2024-09-15T22:56:19.995991+0000","last_fullsized":"2024-09-15T22:56:19.995991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987212+0000","last_change":"2024-09-15T22:56:19.987212+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987212+0000","last_undegraded":"2024-09-15T22:56:19.987212+0000","last_fullsized":"2024-09-15T22:56:19.987212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998605+0000","last_change":"2024-09-15T22:56:19.998605+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998605+0000","last_undegraded":"2024-09-15T22:56:19.998605+0000","last_fullsized":"2024-09-15T22:56:19.998605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985845+0000","last_change":"2024-09-15T22:56:19.985845+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985845+0000","last_undegraded":"2024-09-15T22:56:19.985845+0000","last_fullsized":"2024-09-15T22:56:19.985845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.020639+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:20.020639+0000","last_peered":"2024-09-15T22:56:20.020639+0000","last_clean":"2024-09-15T22:56:20.020639+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:20.020639+0000","last_undegraded":"2024-09-15T22:56:20.020639+0000","last_fullsized":"2024-09-15T22:56:20.020639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994960+0000","last_change":"2024-09-15T22:56:19.994960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994960+0000","last_undegraded":"2024-09-15T22:56:19.994960+0000","last_fullsized":"2024-09-15T22:56:19.994960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028259+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:20.028259+0000","last_peered":"2024-09-15T22:56:20.028259+0000","last_clean":"2024-09-15T22:56:20.028259+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:20.028259+0000","last_undegraded":"2024-09-15T22:56:20.028259+0000","last_fullsized":"2024-09-15T22:56:20.028259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027496+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:20.027496+0000","last_peered":"2024-09-15T22:56:20.027496+0000","last_clean":"2024-09-15T22:56:20.027496+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:20.027496+0000","last_undegraded":"2024-09-15T22:56:20.027496+0000","last_fullsized":"2024-09-15T22:56:20.027496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996831+0000","last_change":"2024-09-15T22:56:19.996831+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996831+0000","last_undegraded":"2024-09-15T22:56:19.996831+0000","last_fullsized":"2024-09-15T22:56:19.996831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012753+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:20.012753+0000","last_peered":"2024-09-15T22:56:20.012753+0000","last_clean":"2024-09-15T22:56:20.012753+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:20.012753+0000","last_undegraded":"2024-09-15T22:56:20.012753+0000","last_fullsized":"2024-09-15T22:56:20.012753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:15.954127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988501+0000","last_change":"2024-09-15T22:56:19.988501+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988501+0000","last_undegraded":"2024-09-15T22:56:19.988501+0000","last_fullsized":"2024-09-15T22:56:19.988501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.027968+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:20.027968+0000","last_peered":"2024-09-15T22:56:20.027968+0000","last_clean":"2024-09-15T22:56:20.027968+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:20.027968+0000","last_undegraded":"2024-09-15T22:56:20.027968+0000","last_fullsized":"2024-09-15T22:56:20.027968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.987423+0000","last_change":"2024-09-15T22:56:19.987423+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.987423+0000","last_undegraded":"2024-09-15T22:56:19.987423+0000","last_fullsized":"2024-09-15T22:56:19.987423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028178+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:20.028178+0000","last_peered":"2024-09-15T22:56:20.028178+0000","last_clean":"2024-09-15T22:56:20.028178+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:20.028178+0000","last_undegraded":"2024-09-15T22:56:20.028178+0000","last_fullsized":"2024-09-15T22:56:20.028178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.995682+0000","last_change":"2024-09-15T22:56:19.995682+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.995682+0000","last_undegraded":"2024-09-15T22:56:19.995682+0000","last_fullsized":"2024-09-15T22:56:19.995682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016489+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:20.016489+0000","last_peered":"2024-09-15T22:56:20.016489+0000","last_clean":"2024-09-15T22:56:20.016489+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:20.016489+0000","last_undegraded":"2024-09-15T22:56:20.016489+0000","last_fullsized":"2024-09-15T22:56:20.016489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.983761+0000","last_change":"2024-09-15T22:56:19.983761+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.983761+0000","last_undegraded":"2024-09-15T22:56:19.983761+0000","last_fullsized":"2024-09-15T22:56:19.983761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028294+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:20.028294+0000","last_peered":"2024-09-15T22:56:20.028294+0000","last_clean":"2024-09-15T22:56:20.028294+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:20.028294+0000","last_undegraded":"2024-09-15T22:56:20.028294+0000","last_fullsized":"2024-09-15T22:56:20.028294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.014809+0000","last_change":"2024-09-15T22:56:20.014809+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.014809+0000","last_undegraded":"2024-09-15T22:56:20.014809+0000","last_fullsized":"2024-09-15T22:56:20.014809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012371+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:20.012371+0000","last_peered":"2024-09-15T22:56:20.012371+0000","last_clean":"2024-09-15T22:56:20.012371+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:20.012371+0000","last_undegraded":"2024-09-15T22:56:20.012371+0000","last_fullsized":"2024-09-15T22:56:20.012371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992292+0000","last_change":"2024-09-15T22:56:19.992292+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992292+0000","last_undegraded":"2024-09-15T22:56:19.992292+0000","last_fullsized":"2024-09-15T22:56:19.992292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013872+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:20.013872+0000","last_peered":"2024-09-15T22:56:20.013872+0000","last_clean":"2024-09-15T22:56:20.013872+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:20.013872+0000","last_undegraded":"2024-09-15T22:56:20.013872+0000","last_fullsized":"2024-09-15T22:56:20.013872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991128+0000","last_change":"2024-09-15T22:56:19.991128+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991128+0000","last_undegraded":"2024-09-15T22:56:19.991128+0000","last_fullsized":"2024-09-15T22:56:19.991128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028302+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:20.028302+0000","last_peered":"2024-09-15T22:56:20.028302+0000","last_clean":"2024-09-15T22:56:20.028302+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:20.028302+0000","last_undegraded":"2024-09-15T22:56:20.028302+0000","last_fullsized":"2024-09-15T22:56:20.028302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992976+0000","last_change":"2024-09-15T22:56:19.992976+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992976+0000","last_undegraded":"2024-09-15T22:56:19.992976+0000","last_fullsized":"2024-09-15T22:56:19.992976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:19.995842+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:19.995842+0000","last_peered":"2024-09-15T22:56:19.995842+0000","last_clean":"2024-09-15T22:56:19.995842+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:19.995842+0000","last_undegraded":"2024-09-15T22:56:19.995842+0000","last_fullsized":"2024-09-15T22:56:19.995842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.992162+0000","last_change":"2024-09-15T22:56:19.992162+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.992162+0000","last_undegraded":"2024-09-15T22:56:19.992162+0000","last_fullsized":"2024-09-15T22:56:19.992162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.014348+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:20.014348+0000","last_peered":"2024-09-15T22:56:20.014348+0000","last_clean":"2024-09-15T22:56:20.014348+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:20.014348+0000","last_undegraded":"2024-09-15T22:56:20.014348+0000","last_fullsized":"2024-09-15T22:56:20.014348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991190+0000","last_change":"2024-09-15T22:56:19.991190+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991190+0000","last_undegraded":"2024-09-15T22:56:19.991190+0000","last_fullsized":"2024-09-15T22:56:19.991190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.010908+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:20.010908+0000","last_peered":"2024-09-15T22:56:20.010908+0000","last_clean":"2024-09-15T22:56:20.010908+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:20.010908+0000","last_undegraded":"2024-09-15T22:56:20.010908+0000","last_fullsized":"2024-09-15T22:56:20.010908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994660+0000","last_change":"2024-09-15T22:56:19.994660+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994660+0000","last_undegraded":"2024-09-15T22:56:19.994660+0000","last_fullsized":"2024-09-15T22:56:19.994660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005340+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:20.005340+0000","last_peered":"2024-09-15T22:56:20.005340+0000","last_clean":"2024-09-15T22:56:20.005340+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:20.005340+0000","last_undegraded":"2024-09-15T22:56:20.005340+0000","last_fullsized":"2024-09-15T22:56:20.005340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.991249+0000","last_change":"2024-09-15T22:56:19.991249+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.991249+0000","last_undegraded":"2024-09-15T22:56:19.991249+0000","last_fullsized":"2024-09-15T22:56:19.991249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.009183+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:20.009183+0000","last_peered":"2024-09-15T22:56:20.009183+0000","last_clean":"2024-09-15T22:56:20.009183+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:20.009183+0000","last_undegraded":"2024-09-15T22:56:20.009183+0000","last_fullsized":"2024-09-15T22:56:20.009183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.007677+0000","last_change":"2024-09-15T22:56:20.007677+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.007677+0000","last_undegraded":"2024-09-15T22:56:20.007677+0000","last_fullsized":"2024-09-15T22:56:20.007677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.016116+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:20.016116+0000","last_peered":"2024-09-15T22:56:20.016116+0000","last_clean":"2024-09-15T22:56:20.016116+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:20.016116+0000","last_undegraded":"2024-09-15T22:56:20.016116+0000","last_fullsized":"2024-09-15T22:56:20.016116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013798+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:20.013798+0000","last_peered":"2024-09-15T22:56:20.013798+0000","last_clean":"2024-09-15T22:56:20.013798+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:20.013798+0000","last_undegraded":"2024-09-15T22:56:20.013798+0000","last_fullsized":"2024-09-15T22:56:20.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.998090+0000","last_change":"2024-09-15T22:56:19.998090+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.998090+0000","last_undegraded":"2024-09-15T22:56:19.998090+0000","last_fullsized":"2024-09-15T22:56:19.998090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030667+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:20.030667+0000","last_peered":"2024-09-15T22:56:20.030667+0000","last_clean":"2024-09-15T22:56:20.030667+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:20.030667+0000","last_undegraded":"2024-09-15T22:56:20.030667+0000","last_fullsized":"2024-09-15T22:56:20.030667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993612+0000","last_change":"2024-09-15T22:56:19.993612+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993612+0000","last_undegraded":"2024-09-15T22:56:19.993612+0000","last_fullsized":"2024-09-15T22:56:19.993612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.004782+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:20.004782+0000","last_peered":"2024-09-15T22:56:20.004782+0000","last_clean":"2024-09-15T22:56:20.004782+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:20.004782+0000","last_undegraded":"2024-09-15T22:56:20.004782+0000","last_fullsized":"2024-09-15T22:56:20.004782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.990325+0000","last_change":"2024-09-15T22:56:19.990325+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.990325+0000","last_undegraded":"2024-09-15T22:56:19.990325+0000","last_fullsized":"2024-09-15T22:56:19.990325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.013524+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:20.013524+0000","last_peered":"2024-09-15T22:56:20.013524+0000","last_clean":"2024-09-15T22:56:20.013524+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:20.013524+0000","last_undegraded":"2024-09-15T22:56:20.013524+0000","last_fullsized":"2024-09-15T22:56:20.013524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984483+0000","last_change":"2024-09-15T22:56:19.984483+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984483+0000","last_undegraded":"2024-09-15T22:56:19.984483+0000","last_fullsized":"2024-09-15T22:56:19.984483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012385+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:20.012385+0000","last_peered":"2024-09-15T22:56:20.012385+0000","last_clean":"2024-09-15T22:56:20.012385+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:20.012385+0000","last_undegraded":"2024-09-15T22:56:20.012385+0000","last_fullsized":"2024-09-15T22:56:20.012385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:12.740705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.985889+0000","last_change":"2024-09-15T22:56:19.985889+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.985889+0000","last_undegraded":"2024-09-15T22:56:19.985889+0000","last_fullsized":"2024-09-15T22:56:19.985889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030746+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:20.030746+0000","last_peered":"2024-09-15T22:56:20.030746+0000","last_clean":"2024-09-15T22:56:20.030746+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:20.030746+0000","last_undegraded":"2024-09-15T22:56:20.030746+0000","last_fullsized":"2024-09-15T22:56:20.030746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.988568+0000","last_change":"2024-09-15T22:56:19.988568+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.988568+0000","last_undegraded":"2024-09-15T22:56:19.988568+0000","last_fullsized":"2024-09-15T22:56:19.988568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.025478+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:20.025478+0000","last_peered":"2024-09-15T22:56:20.025478+0000","last_clean":"2024-09-15T22:56:20.025478+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:20.025478+0000","last_undegraded":"2024-09-15T22:56:20.025478+0000","last_fullsized":"2024-09-15T22:56:20.025478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999525+0000","last_change":"2024-09-15T22:56:19.999525+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999525+0000","last_undegraded":"2024-09-15T22:56:19.999525+0000","last_fullsized":"2024-09-15T22:56:19.999525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.028203+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:20.028203+0000","last_peered":"2024-09-15T22:56:20.028203+0000","last_clean":"2024-09-15T22:56:20.028203+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:20.028203+0000","last_undegraded":"2024-09-15T22:56:20.028203+0000","last_fullsized":"2024-09-15T22:56:20.028203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993147+0000","last_change":"2024-09-15T22:56:19.993147+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993147+0000","last_undegraded":"2024-09-15T22:56:19.993147+0000","last_fullsized":"2024-09-15T22:56:19.993147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030626+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:20.030626+0000","last_peered":"2024-09-15T22:56:20.030626+0000","last_clean":"2024-09-15T22:56:20.030626+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:20.030626+0000","last_undegraded":"2024-09-15T22:56:20.030626+0000","last_fullsized":"2024-09-15T22:56:20.030626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.984127+0000","last_change":"2024-09-15T22:56:19.984127+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.984127+0000","last_undegraded":"2024-09-15T22:56:19.984127+0000","last_fullsized":"2024-09-15T22:56:19.984127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.018179+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:20.018179+0000","last_peered":"2024-09-15T22:56:20.018179+0000","last_clean":"2024-09-15T22:56:20.018179+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:20.018179+0000","last_undegraded":"2024-09-15T22:56:20.018179+0000","last_fullsized":"2024-09-15T22:56:20.018179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.994782+0000","last_change":"2024-09-15T22:56:19.994782+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.994782+0000","last_undegraded":"2024-09-15T22:56:19.994782+0000","last_fullsized":"2024-09-15T22:56:19.994782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.005945+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:20.005945+0000","last_peered":"2024-09-15T22:56:20.005945+0000","last_clean":"2024-09-15T22:56:20.005945+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:20.005945+0000","last_undegraded":"2024-09-15T22:56:20.005945+0000","last_fullsized":"2024-09-15T22:56:20.005945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001661+0000","last_change":"2024-09-15T22:56:20.001661+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001661+0000","last_undegraded":"2024-09-15T22:56:20.001661+0000","last_fullsized":"2024-09-15T22:56:20.001661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.033373+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:20.033373+0000","last_peered":"2024-09-15T22:56:20.033373+0000","last_clean":"2024-09-15T22:56:20.033373+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:20.033373+0000","last_undegraded":"2024-09-15T22:56:20.033373+0000","last_fullsized":"2024-09-15T22:56:20.033373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001960+0000","last_change":"2024-09-15T22:56:20.001960+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001960+0000","last_undegraded":"2024-09-15T22:56:20.001960+0000","last_fullsized":"2024-09-15T22:56:20.001960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.999146+0000","last_change":"2024-09-15T22:56:19.999146+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.999146+0000","last_undegraded":"2024-09-15T22:56:19.999146+0000","last_fullsized":"2024-09-15T22:56:19.999146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030603+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:20.030603+0000","last_peered":"2024-09-15T22:56:20.030603+0000","last_clean":"2024-09-15T22:56:20.030603+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:20.030603+0000","last_undegraded":"2024-09-15T22:56:20.030603+0000","last_fullsized":"2024-09-15T22:56:20.030603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.993826+0000","last_change":"2024-09-15T22:56:19.993826+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.993826+0000","last_undegraded":"2024-09-15T22:56:19.993826+0000","last_fullsized":"2024-09-15T22:56:19.993826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.030591+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:20.030591+0000","last_peered":"2024-09-15T22:56:20.030591+0000","last_clean":"2024-09-15T22:56:20.030591+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:20.030591+0000","last_undegraded":"2024-09-15T22:56:20.030591+0000","last_fullsized":"2024-09-15T22:56:20.030591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:19.996479+0000","last_change":"2024-09-15T22:56:19.996479+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:19.996479+0000","last_undegraded":"2024-09-15T22:56:19.996479+0000","last_fullsized":"2024-09-15T22:56:19.996479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.012711+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:20.012711+0000","last_peered":"2024-09-15T22:56:20.012711+0000","last_clean":"2024-09-15T22:56:20.012711+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:20.012711+0000","last_undegraded":"2024-09-15T22:56:20.012711+0000","last_fullsized":"2024-09-15T22:56:20.012711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:08.631116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-15T22:56:20.001152+0000","last_change":"2024-09-15T22:56:20.001152+0000","last_active":"2024-09-15T22:56:19.972761+0000","last_peered":"2024-09-15T22:56:19.972761+0000","last_clean":"2024-09-15T22:56:19.972761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:56:20.001152+0000","last_undegraded":"2024-09-15T22:56:20.001152+0000","last_fullsized":"2024-09-15T22:56:20.001152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T22:56:20.023491+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:20.023491+0000","last_peered":"2024-09-15T22:56:20.023491+0000","last_clean":"2024-09-15T22:56:20.023491+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:20.023491+0000","last_undegraded":"2024-09-15T22:56:20.023491+0000","last_fullsized":"2024-09-15T22:56:20.023491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.938818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.999967+0000', 'last_change': '2024-09-15T22:56:19.999967+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.999967+0000', 'last_undegraded': '2024-09-15T22:56:19.999967+0000', 'last_fullsized': '2024-09-15T22:56:19.999967+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.989863+0000', 'last_change': '2024-09-15T22:56:19.989863+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.989863+0000', 'last_undegraded': '2024-09-15T22:56:19.989863+0000', 'last_fullsized': '2024-09-15T22:56:19.989863+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-15T22:56:25.813 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.992776+0000', 'last_change': '2024-09-15T22:56:19.992776+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.992776+0000', 'last_undegraded': '2024-09-15T22:56:19.992776+0000', 'last_fullsized': '2024-09-15T22:56:19.992776+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.994974+0000', 'last_change': '2024-09-15T22:56:19.994974+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.994974+0000', 'last_undegraded': '2024-09-15T22:56:19.994974+0000', 'last_fullsized': '2024-09-15T22:56:19.994974+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.992877+0000', 'last_change': '2024-09-15T22:56:19.992877+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.992877+0000', 'last_undegraded': '2024-09-15T22:56:19.992877+0000', 'last_fullsized': '2024-09-15T22:56:19.992877+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.999894+0000', 'last_change': '2024-09-15T22:56:19.999894+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.999894+0000', 'last_undegraded': '2024-09-15T22:56:19.999894+0000', 'last_fullsized': '2024-09-15T22:56:19.999894+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.994033+0000', 'last_change': '2024-09-15T22:56:19.994033+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.994033+0000', 'last_undegraded': '2024-09-15T22:56:19.994033+0000', 'last_fullsized': '2024-09-15T22:56:19.994033+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.998038+0000', 'last_change': '2024-09-15T22:56:19.998038+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.998038+0000', 'last_undegraded': '2024-09-15T22:56:19.998038+0000', 'last_fullsized': '2024-09-15T22:56:19.998038+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.814 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.995462+0000', 'last_change': '2024-09-15T22:56:19.995462+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.995462+0000', 'last_undegraded': '2024-09-15T22:56:19.995462+0000', 'last_fullsized': '2024-09-15T22:56:19.995462+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.014944+0000', 'last_change': '2024-09-15T22:56:20.014944+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.014944+0000', 'last_undegraded': '2024-09-15T22:56:20.014944+0000', 'last_fullsized': '2024-09-15T22:56:20.014944+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.991946+0000', 'last_change': '2024-09-15T22:56:19.991946+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.991946+0000', 'last_undegraded': '2024-09-15T22:56:19.991946+0000', 'last_fullsized': '2024-09-15T22:56:19.991946+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.988652+0000', 'last_change': '2024-09-15T22:56:19.988652+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.988652+0000', 'last_undegraded': '2024-09-15T22:56:19.988652+0000', 'last_fullsized': '2024-09-15T22:56:19.988652+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.002453+0000', 'last_change': '2024-09-15T22:56:20.002453+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.002453+0000', 'last_undegraded': '2024-09-15T22:56:20.002453+0000', 'last_fullsized': '2024-09-15T22:56:20.002453+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-15T22:56:25.815 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.999827+0000', 'last_change': '2024-09-15T22:56:19.999827+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.999827+0000', 'last_undegraded': '2024-09-15T22:56:19.999827+0000', 'last_fullsized': '2024-09-15T22:56:19.999827+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.989752+0000', 'last_change': '2024-09-15T22:56:19.989752+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.989752+0000', 'last_undegraded': '2024-09-15T22:56:19.989752+0000', 'last_fullsized': '2024-09-15T22:56:19.989752+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.993848+0000', 'last_change': '2024-09-15T22:56:19.993848+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.993848+0000', 'last_undegraded': '2024-09-15T22:56:19.993848+0000', 'last_fullsized': '2024-09-15T22:56:19.993848+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.986296+0000', 'last_change': '2024-09-15T22:56:19.986296+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.986296+0000', 'last_undegraded': '2024-09-15T22:56:19.986296+0000', 'last_fullsized': '2024-09-15T22:56:19.986296+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.987524+0000', 'last_change': '2024-09-15T22:56:19.987524+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.987524+0000', 'last_undegraded': '2024-09-15T22:56:19.987524+0000', 'last_fullsized': '2024-09-15T22:56:19.987524+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.006588+0000', 'last_change': '2024-09-15T22:56:20.006588+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.006588+0000', 'last_undegraded': '2024-09-15T22:56:20.006588+0000', 'last_fullsized': '2024-09-15T22:56:20.006588+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.816 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.993379+0000', 'last_change': '2024-09-15T22:56:19.993379+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.993379+0000', 'last_undegraded': '2024-09-15T22:56:19.993379+0000', 'last_fullsized': '2024-09-15T22:56:19.993379+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.007240+0000', 'last_change': '2024-09-15T22:56:20.007240+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.007240+0000', 'last_undegraded': '2024-09-15T22:56:20.007240+0000', 'last_fullsized': '2024-09-15T22:56:20.007240+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.998141+0000', 'last_change': '2024-09-15T22:56:19.998141+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.998141+0000', 'last_undegraded': '2024-09-15T22:56:19.998141+0000', 'last_fullsized': '2024-09-15T22:56:19.998141+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.997311+0000', 'last_change': '2024-09-15T22:56:19.997311+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.997311+0000', 'last_undegraded': '2024-09-15T22:56:19.997311+0000', 'last_fullsized': '2024-09-15T22:56:19.997311+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.987655+0000', 'last_change': '2024-09-15T22:56:19.987655+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.987655+0000', 'last_undegraded': '2024-09-15T22:56:19.987655+0000', 'last_fullsized': '2024-09-15T22:56:19.987655+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.817 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.000313+0000', 'last_change': '2024-09-15T22:56:20.000313+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.000313+0000', 'last_undegraded': '2024-09-15T22:56:20.000313+0000', 'last_fullsized': '2024-09-15T22:56:20.000313+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.005100+0000', 'last_change': '2024-09-15T22:56:20.005100+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.005100+0000', 'last_undegraded': '2024-09-15T22:56:20.005100+0000', 'last_fullsized': '2024-09-15T22:56:20.005100+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.988951+0000', 'last_change': '2024-09-15T22:56:19.988951+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.988951+0000', 'last_undegraded': '2024-09-15T22:56:19.988951+0000', 'last_fullsized': '2024-09-15T22:56:19.988951+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.996166+0000', 'last_change': '2024-09-15T22:56:19.996166+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.996166+0000', 'last_undegraded': '2024-09-15T22:56:19.996166+0000', 'last_fullsized': '2024-09-15T22:56:19.996166+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.006410+0000', 'last_change': '2024-09-15T22:56:20.006410+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.006410+0000', 'last_undegraded': '2024-09-15T22:56:20.006410+0000', 'last_fullsized': '2024-09-15T22:56:20.006410+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-15T22:56:25.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.995991+0000', 'last_change': '2024-09-15T22:56:19.995991+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.995991+0000', 'last_undegraded': '2024-09-15T22:56:19.995991+0000', 'last_fullsized': '2024-09-15T22:56:19.995991+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.987212+0000', 'last_change': '2024-09-15T22:56:19.987212+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.987212+0000', 'last_undegraded': '2024-09-15T22:56:19.987212+0000', 'last_fullsized': '2024-09-15T22:56:19.987212+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.998605+0000', 'last_change': '2024-09-15T22:56:19.998605+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.998605+0000', 'last_undegraded': '2024-09-15T22:56:19.998605+0000', 'last_fullsized': '2024-09-15T22:56:19.998605+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.985845+0000', 'last_change': '2024-09-15T22:56:19.985845+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.985845+0000', 'last_undegraded': '2024-09-15T22:56:19.985845+0000', 'last_fullsized': '2024-09-15T22:56:19.985845+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.994960+0000', 'last_change': '2024-09-15T22:56:19.994960+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.994960+0000', 'last_undegraded': '2024-09-15T22:56:19.994960+0000', 'last_fullsized': '2024-09-15T22:56:19.994960+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.996831+0000', 'last_change': '2024-09-15T22:56:19.996831+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.996831+0000', 'last_undegraded': '2024-09-15T22:56:19.996831+0000', 'last_fullsized': '2024-09-15T22:56:19.996831+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.819 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.988501+0000', 'last_change': '2024-09-15T22:56:19.988501+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.988501+0000', 'last_undegraded': '2024-09-15T22:56:19.988501+0000', 'last_fullsized': '2024-09-15T22:56:19.988501+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.987423+0000', 'last_change': '2024-09-15T22:56:19.987423+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.987423+0000', 'last_undegraded': '2024-09-15T22:56:19.987423+0000', 'last_fullsized': '2024-09-15T22:56:19.987423+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.995682+0000', 'last_change': '2024-09-15T22:56:19.995682+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.995682+0000', 'last_undegraded': '2024-09-15T22:56:19.995682+0000', 'last_fullsized': '2024-09-15T22:56:19.995682+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.983761+0000', 'last_change': '2024-09-15T22:56:19.983761+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.983761+0000', 'last_undegraded': '2024-09-15T22:56:19.983761+0000', 'last_fullsized': '2024-09-15T22:56:19.983761+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.014809+0000', 'last_change': '2024-09-15T22:56:20.014809+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.014809+0000', 'last_undegraded': '2024-09-15T22:56:20.014809+0000', 'last_fullsized': '2024-09-15T22:56:20.014809+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-15T22:56:25.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.992292+0000', 'last_change': '2024-09-15T22:56:19.992292+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.992292+0000', 'last_undegraded': '2024-09-15T22:56:19.992292+0000', 'last_fullsized': '2024-09-15T22:56:19.992292+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.991128+0000', 'last_change': '2024-09-15T22:56:19.991128+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.991128+0000', 'last_undegraded': '2024-09-15T22:56:19.991128+0000', 'last_fullsized': '2024-09-15T22:56:19.991128+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.992976+0000', 'last_change': '2024-09-15T22:56:19.992976+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.992976+0000', 'last_undegraded': '2024-09-15T22:56:19.992976+0000', 'last_fullsized': '2024-09-15T22:56:19.992976+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.992162+0000', 'last_change': '2024-09-15T22:56:19.992162+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.992162+0000', 'last_undegraded': '2024-09-15T22:56:19.992162+0000', 'last_fullsized': '2024-09-15T22:56:19.992162+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-15T22:56:25.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.991190+0000', 'last_change': '2024-09-15T22:56:19.991190+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.991190+0000', 'last_undegraded': '2024-09-15T22:56:19.991190+0000', 'last_fullsized': '2024-09-15T22:56:19.991190+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.994660+0000', 'last_change': '2024-09-15T22:56:19.994660+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.994660+0000', 'last_undegraded': '2024-09-15T22:56:19.994660+0000', 'last_fullsized': '2024-09-15T22:56:19.994660+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.991249+0000', 'last_change': '2024-09-15T22:56:19.991249+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.991249+0000', 'last_undegraded': '2024-09-15T22:56:19.991249+0000', 'last_fullsized': '2024-09-15T22:56:19.991249+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.007677+0000', 'last_change': '2024-09-15T22:56:20.007677+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.007677+0000', 'last_undegraded': '2024-09-15T22:56:20.007677+0000', 'last_fullsized': '2024-09-15T22:56:20.007677+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.998090+0000', 'last_change': '2024-09-15T22:56:19.998090+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.998090+0000', 'last_undegraded': '2024-09-15T22:56:19.998090+0000', 'last_fullsized': '2024-09-15T22:56:19.998090+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.993612+0000', 'last_change': '2024-09-15T22:56:19.993612+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.993612+0000', 'last_undegraded': '2024-09-15T22:56:19.993612+0000', 'last_fullsized': '2024-09-15T22:56:19.993612+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-15T22:56:25.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.990325+0000', 'last_change': '2024-09-15T22:56:19.990325+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.990325+0000', 'last_undegraded': '2024-09-15T22:56:19.990325+0000', 'last_fullsized': '2024-09-15T22:56:19.990325+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.984483+0000', 'last_change': '2024-09-15T22:56:19.984483+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.984483+0000', 'last_undegraded': '2024-09-15T22:56:19.984483+0000', 'last_fullsized': '2024-09-15T22:56:19.984483+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.985889+0000', 'last_change': '2024-09-15T22:56:19.985889+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.985889+0000', 'last_undegraded': '2024-09-15T22:56:19.985889+0000', 'last_fullsized': '2024-09-15T22:56:19.985889+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.988568+0000', 'last_change': '2024-09-15T22:56:19.988568+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.988568+0000', 'last_undegraded': '2024-09-15T22:56:19.988568+0000', 'last_fullsized': '2024-09-15T22:56:19.988568+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.999525+0000', 'last_change': '2024-09-15T22:56:19.999525+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.999525+0000', 'last_undegraded': '2024-09-15T22:56:19.999525+0000', 'last_fullsized': '2024-09-15T22:56:19.999525+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.993147+0000', 'last_change': '2024-09-15T22:56:19.993147+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.993147+0000', 'last_undegraded': '2024-09-15T22:56:19.993147+0000', 'last_fullsized': '2024-09-15T22:56:19.993147+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-15T22:56:25.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.984127+0000', 'last_change': '2024-09-15T22:56:19.984127+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.984127+0000', 'last_undegraded': '2024-09-15T22:56:19.984127+0000', 'last_fullsized': '2024-09-15T22:56:19.984127+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.994782+0000', 'last_change': '2024-09-15T22:56:19.994782+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.994782+0000', 'last_undegraded': '2024-09-15T22:56:19.994782+0000', 'last_fullsized': '2024-09-15T22:56:19.994782+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.001661+0000', 'last_change': '2024-09-15T22:56:20.001661+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.001661+0000', 'last_undegraded': '2024-09-15T22:56:20.001661+0000', 'last_fullsized': '2024-09-15T22:56:20.001661+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.001960+0000', 'last_change': '2024-09-15T22:56:20.001960+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.001960+0000', 'last_undegraded': '2024-09-15T22:56:20.001960+0000', 'last_fullsized': '2024-09-15T22:56:20.001960+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.999146+0000', 'last_change': '2024-09-15T22:56:19.999146+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.999146+0000', 'last_undegraded': '2024-09-15T22:56:19.999146+0000', 'last_fullsized': '2024-09-15T22:56:19.999146+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-15T22:56:25.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.993826+0000', 'last_change': '2024-09-15T22:56:19.993826+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.993826+0000', 'last_undegraded': '2024-09-15T22:56:19.993826+0000', 'last_fullsized': '2024-09-15T22:56:19.993826+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:56:25.825 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-15T22:56:25.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:19.996479+0000', 'last_change': '2024-09-15T22:56:19.996479+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:19.996479+0000', 'last_undegraded': '2024-09-15T22:56:19.996479+0000', 'last_fullsized': '2024-09-15T22:56:19.996479+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:56:25.825 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-15T22:56:25.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:56:20.001152+0000', 'last_change': '2024-09-15T22:56:20.001152+0000', 'last_active': '2024-09-15T22:56:19.972761+0000', 'last_peered': '2024-09-15T22:56:19.972761+0000', 'last_clean': '2024-09-15T22:56:19.972761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:56:20.001152+0000', 'last_undegraded': '2024-09-15T22:56:20.001152+0000', 'last_fullsized': '2024-09-15T22:56:20.001152+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'last_clean_scrub_stamp': '2024-09-15T22:56:19.972761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:56:25.825 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:56:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.977+0000 7f6c641c9640 1 Processor -- start 2024-09-15T22:56:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.977+0000 7f6c641c9640 1 -- start start 2024-09-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 0x7f6c5c073e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c5c0cee70 0x7f6c5c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c15c800 0x7f6c5c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5c073170 con 0x7f6c5c0cee70 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5c15d7a0 con 0x7f6c5c071a80 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c641c9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c15d4c0 con 0x7f6c5c15c800 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c5c0cee70 0x7f6c5c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c5c0cee70 0x7f6c5c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34496/0 (socket says 172.21.15.28:34496) 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 -- 172.21.15.28:0/3165982464 learned_addr learned my addr 172.21.15.28:0/3165982464 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c62766640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c15c800 0x7f6c5c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61f65640 1 --2- 172.21.15.28:0/3165982464 >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 0x7f6c5c073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 -- 172.21.15.28:0/3165982464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c15c800 msgr2=0x7f6c5c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c15c800 0x7f6c5c15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 -- 172.21.15.28:0/3165982464 >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 msgr2=0x7f6c5c073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 --2- 172.21.15.28:0/3165982464 >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 0x7f6c5c073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 -- 172.21.15.28:0/3165982464 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c0733a0 con 0x7f6c5c0cee70 2024-09-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61f65640 1 --2- 172.21.15.28:0/3165982464 >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 0x7f6c5c073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c61764640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c0cee70 0x7f6c5c0cf300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c06e080 tx=0x7f6c5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3146323e2a00f5c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c60f63640 1 -- 172.21.15.28:0/3165982464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580b2070 con 0x7f6c5c0cee70 2024-09-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c60f63640 1 -- 172.21.15.28:0/3165982464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c580a9070 con 0x7f6c5c0cee70 2024-09-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.981+0000 7f6c60f63640 1 -- 172.21.15.28:0/3165982464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580ad880 con 0x7f6c5c0cee70 2024-09-15T22:56:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/3165982464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c0cee70 msgr2=0x7f6c5c0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c0cee70 0x7f6c5c0cf300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c06e080 tx=0x7f6c5801c490 comp rx=0 tx=0).stop 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/3165982464 shutdown_connections 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c15c800 0x7f6c5c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- 172.21.15.28:0/3165982464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c0cee70 0x7f6c5c0cf300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- 172.21.15.28:0/3165982464 >> v2:172.21.15.131:3300/0 conn(0x7f6c5c071a80 0x7f6c5c073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/3165982464 >> 172.21.15.28:0/3165982464 conn(0x7f6c5c06bcc0 msgr2=0x7f6c5c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/3165982464 shutdown_connections 2024-09-15T22:56:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/3165982464 wait complete. 2024-09-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 Processor -- start 2024-09-15T22:56:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- start start 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c0cee70 0x7f6c5c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c5c15c800 0x7f6c5c149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b43c0 con 0x7f6c5c071a80 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b4240 con 0x7f6c5c15c800 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b4540 con 0x7f6c5c0cee70 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34498/0 (socket says 172.21.15.28:34498) 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 -- 172.21.15.28:0/1615173783 learned_addr learned my addr 172.21.15.28:0/1615173783 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c62766640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c5c15c800 0x7f6c5c149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61764640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c0cee70 0x7f6c5c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 -- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c0cee70 msgr2=0x7f6c5c146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c0cee70 0x7f6c5c146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 -- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c5c15c800 msgr2=0x7f6c5c149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c5c15c800 0x7f6c5c149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 -- 172.21.15.28:0/1615173783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c14e490 con 0x7f6c5c071a80 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c61f65640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00d830 tx=0x7f6c4c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c018070 con 0x7f6c5c071a80 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00be10 con 0x7f6c5c071a80 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c14e770 con 0x7f6c5c071a80 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c004250 con 0x7f6c5c071a80 2024-09-15T22:56:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.985+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c14ed30 con 0x7f6c5c071a80 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c0694b0 con 0x7f6c5c071a80 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c4c0098b0 con 0x7f6c5c071a80 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c527fc640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 0x7f6c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c4c085f80 con 0x7f6c5c071a80 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c61764640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 0x7f6c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.989+0000 7f6c61764640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 0x7f6c40069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c580af000 tx=0x7f6c58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:25.993+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c4c056ac0 con 0x7f6c5c071a80 2024-09-15T22:56:26.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.208+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6c5c073e80 con 0x7f6c5c071a80 2024-09-15T22:56:26.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.208+0000 7f6c527fc640 1 -- 172.21.15.28:0/1615173783 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7f6c4c0563c0 con 0x7f6c5c071a80 2024-09-15T22:56:26.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:26.210 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440969,"num_in_osds":8,"osd_in_since":1726440959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":241389568,"bytes_avail":772852723712,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4285}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T22:55:57.074897+0000","services":{}},"progress_events":{}} 2024-09-15T22:56:26.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 msgr2=0x7f6c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 0x7f6c40069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c580af000 tx=0x7f6c58008040 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 msgr2=0x7f6c5c14f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00d830 tx=0x7f6c4c00dcf0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 shutdown_connections 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6c400678c0 0x7f6c40069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c5c15c800 0x7f6c5c149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c5c0cee70 0x7f6c5c146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 --2- 172.21.15.28:0/1615173783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c5c071a80 0x7f6c5c14f530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 >> 172.21.15.28:0/1615173783 conn(0x7f6c5c06bcc0 msgr2=0x7f6c5c0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 shutdown_connections 2024-09-15T22:56:26.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.212+0000 7f6c641c9640 1 -- 172.21.15.28:0/1615173783 wait complete. 2024-09-15T22:56:26.228 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:56:26.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:26.303 INFO:tasks.ceph.mds.b.smithi131.stderr:2024-09-15T22:56:26.302+0000 7f2d91d0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:56:26.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 Processor -- start 2024-09-15T22:56:26.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 -- start start 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7eff9806d870 0x7eff9806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff980d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9806e190 con 0x7eff9815e820 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7eff980d2ba0 con 0x7eff9806d870 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9c90a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7eff980d2e80 con 0x7eff980b3610 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7eff9806d870 0x7eff9806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7eff9806d870 0x7eff9806dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34504/0 (socket says 172.21.15.28:34504) 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 -- 172.21.15.28:0/2500125393 learned_addr learned my addr 172.21.15.28:0/2500125393 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff96d9d640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff980d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 -- 172.21.15.28:0/2500125393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 msgr2=0x7eff980d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff980d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 -- 172.21.15.28:0/2500125393 >> v1:172.21.15.131:6789/0 conn(0x7eff9815e820 legacy=0x7eff980cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.348+0000 7eff9659c640 1 -- 172.21.15.28:0/2500125393 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff980d3160 con 0x7eff9806d870 2024-09-15T22:56:26.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9659c640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9806d870 0x7eff9806dc50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff80009e50 tx=0x7eff8001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301daed5190c3d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9559a640 1 -- 172.21.15.28:0/2500125393 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800a58f0 con 0x7eff9806d870 2024-09-15T22:56:26.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9559a640 1 -- 172.21.15.28:0/2500125393 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff800a5a90 con 0x7eff9806d870 2024-09-15T22:56:26.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9559a640 1 -- 172.21.15.28:0/2500125393 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800a5e60 con 0x7eff9806d870 2024-09-15T22:56:26.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- 172.21.15.28:0/2500125393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9806d870 msgr2=0x7eff9806dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9806d870 0x7eff9806dc50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff80009e50 tx=0x7eff8001ca00 comp rx=0 tx=0).stop 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- 172.21.15.28:0/2500125393 shutdown_connections 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff980d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- 172.21.15.28:0/2500125393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9806d870 0x7eff9806dc50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- 172.21.15.28:0/2500125393 >> 172.21.15.28:0/2500125393 conn(0x7eff980d4910 msgr2=0x7eff980d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- 172.21.15.28:0/2500125393 shutdown_connections 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- 172.21.15.28:0/2500125393 wait complete. 2024-09-15T22:56:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 Processor -- start 2024-09-15T22:56:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- start start 2024-09-15T22:56:26.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff9806d870 0x7eff9815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff98158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7eff9816b530 con 0x7eff9815e820 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7eff9816b3b0 con 0x7eff9806d870 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9c90a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7eff9816b6b0 con 0x7eff980b3610 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34520/0 (socket says 172.21.15.28:34520) 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 -- 172.21.15.28:0/3327946506 learned_addr learned my addr 172.21.15.28:0/3327946506 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff9659c640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff9806d870 0x7eff9815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff95d9b640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff98158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 -- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 msgr2=0x7eff98158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff98158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 -- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff9806d870 msgr2=0x7eff9815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff9806d870 0x7eff9815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 -- 172.21.15.28:0/3327946506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9815b3d0 con 0x7eff9815e820 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff96d9d640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff9000d800 tx=0x7eff9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.352+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9000b6c0 con 0x7eff9815e820 2024-09-15T22:56:26.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff90019070 con 0x7eff9815e820 2024-09-15T22:56:26.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9815b6b0 con 0x7eff9815e820 2024-09-15T22:56:26.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9000baa0 con 0x7eff9815e820 2024-09-15T22:56:26.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9815bc70 con 0x7eff9815e820 2024-09-15T22:56:26.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9806dc50 con 0x7eff9815e820 2024-09-15T22:56:26.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff9000bc40 con 0x7eff9815e820 2024-09-15T22:56:26.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff8effd640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 0x7eff78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7eff90086bd0 con 0x7eff9815e820 2024-09-15T22:56:26.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff9659c640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 0x7eff78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.356+0000 7eff9659c640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 0x7eff78069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae000 tx=0x7eff800a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.360+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff90057760 con 0x7eff9815e820 2024-09-15T22:56:26.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.520+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff980d22d0 con 0x7eff780678c0 2024-09-15T22:56:26.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.536+0000 7eff8effd640 1 -- 172.21.15.28:0/3327946506 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7eff980d22d0 con 0x7eff780678c0 2024-09-15T22:56:26.542 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:26.543 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 msgr2=0x7eff78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 0x7eff78069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae000 tx=0x7eff800a7070 comp rx=0 tx=0).stop 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 msgr2=0x7eff98159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff9000d800 tx=0x7eff9000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 shutdown_connections 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff9815e820 0x7eff98159390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7eff980b3610 0x7eff98158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff780678c0 0x7eff78069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 --2- 172.21.15.28:0/3327946506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff9806d870 0x7eff9815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 >> 172.21.15.28:0/3327946506 conn(0x7eff980d4910 msgr2=0x7eff980cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 shutdown_connections 2024-09-15T22:56:26.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:26.540+0000 7eff9c90a640 1 -- 172.21.15.28:0/3327946506 wait complete. 2024-09-15T22:56:26.559 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-15T22:56:25.868029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001574"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180547+0000","last_change":"2024-09-15T22:56:21.056451+0000","last_active":"2024-09-15T22:56:23.180547+0000","last_peered":"2024-09-15T22:56:23.180547+0000","last_clean":"2024-09-15T22:56:23.180547+0000","last_became_active":"2024-09-15T22:56:21.056145+0000","last_became_peered":"2024-09-15T22:56:21.056145+0000","last_unstale":"2024-09-15T22:56:23.180547+0000","last_undegraded":"2024-09-15T22:56:23.180547+0000","last_fullsized":"2024-09-15T22:56:23.180547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003947+0000","last_change":"2024-09-15T22:56:21.032126+0000","last_active":"2024-09-15T22:56:22.003947+0000","last_peered":"2024-09-15T22:56:22.003947+0000","last_clean":"2024-09-15T22:56:22.003947+0000","last_became_active":"2024-09-15T22:56:21.031366+0000","last_became_peered":"2024-09-15T22:56:21.031366+0000","last_unstale":"2024-09-15T22:56:22.003947+0000","last_undegraded":"2024-09-15T22:56:22.003947+0000","last_fullsized":"2024-09-15T22:56:22.003947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142427+0000","last_change":"2024-09-15T22:56:21.019102+0000","last_active":"2024-09-15T22:56:22.142427+0000","last_peered":"2024-09-15T22:56:22.142427+0000","last_clean":"2024-09-15T22:56:22.142427+0000","last_became_active":"2024-09-15T22:56:21.018279+0000","last_became_peered":"2024-09-15T22:56:21.018279+0000","last_unstale":"2024-09-15T22:56:22.142427+0000","last_undegraded":"2024-09-15T22:56:22.142427+0000","last_fullsized":"2024-09-15T22:56:22.142427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005366+0000","last_change":"2024-09-15T22:56:21.038401+0000","last_active":"2024-09-15T22:56:22.005366+0000","last_peered":"2024-09-15T22:56:22.005366+0000","last_clean":"2024-09-15T22:56:22.005366+0000","last_became_active":"2024-09-15T22:56:21.037254+0000","last_became_peered":"2024-09-15T22:56:21.037254+0000","last_unstale":"2024-09-15T22:56:22.005366+0000","last_undegraded":"2024-09-15T22:56:22.005366+0000","last_fullsized":"2024-09-15T22:56:22.005366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180159+0000","last_change":"2024-09-15T22:56:21.045620+0000","last_active":"2024-09-15T22:56:23.180159+0000","last_peered":"2024-09-15T22:56:23.180159+0000","last_clean":"2024-09-15T22:56:23.180159+0000","last_became_active":"2024-09-15T22:56:21.044268+0000","last_became_peered":"2024-09-15T22:56:21.044268+0000","last_unstale":"2024-09-15T22:56:23.180159+0000","last_undegraded":"2024-09-15T22:56:23.180159+0000","last_fullsized":"2024-09-15T22:56:23.180159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006657+0000","last_change":"2024-09-15T22:56:21.032910+0000","last_active":"2024-09-15T22:56:22.006657+0000","last_peered":"2024-09-15T22:56:22.006657+0000","last_clean":"2024-09-15T22:56:22.006657+0000","last_became_active":"2024-09-15T22:56:21.032121+0000","last_became_peered":"2024-09-15T22:56:21.032121+0000","last_unstale":"2024-09-15T22:56:22.006657+0000","last_undegraded":"2024-09-15T22:56:22.006657+0000","last_fullsized":"2024-09-15T22:56:22.006657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179615+0000","last_change":"2024-09-15T22:56:21.040858+0000","last_active":"2024-09-15T22:56:23.179615+0000","last_peered":"2024-09-15T22:56:23.179615+0000","last_clean":"2024-09-15T22:56:23.179615+0000","last_became_active":"2024-09-15T22:56:21.040118+0000","last_became_peered":"2024-09-15T22:56:21.040118+0000","last_unstale":"2024-09-15T22:56:23.179615+0000","last_undegraded":"2024-09-15T22:56:23.179615+0000","last_fullsized":"2024-09-15T22:56:23.179615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216724+0000","last_change":"2024-09-15T22:56:21.045328+0000","last_active":"2024-09-15T22:56:22.216724+0000","last_peered":"2024-09-15T22:56:22.216724+0000","last_clean":"2024-09-15T22:56:22.216724+0000","last_became_active":"2024-09-15T22:56:21.041149+0000","last_became_peered":"2024-09-15T22:56:21.041149+0000","last_unstale":"2024-09-15T22:56:22.216724+0000","last_undegraded":"2024-09-15T22:56:22.216724+0000","last_fullsized":"2024-09-15T22:56:22.216724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180976+0000","last_change":"2024-09-15T22:56:21.050262+0000","last_active":"2024-09-15T22:56:23.180976+0000","last_peered":"2024-09-15T22:56:23.180976+0000","last_clean":"2024-09-15T22:56:23.180976+0000","last_became_active":"2024-09-15T22:56:21.049947+0000","last_became_peered":"2024-09-15T22:56:21.049947+0000","last_unstale":"2024-09-15T22:56:23.180976+0000","last_undegraded":"2024-09-15T22:56:23.180976+0000","last_fullsized":"2024-09-15T22:56:23.180976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:10.140812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050907+0000","last_change":"2024-09-15T22:56:21.047268+0000","last_active":"2024-09-15T22:56:22.050907+0000","last_peered":"2024-09-15T22:56:22.050907+0000","last_clean":"2024-09-15T22:56:22.050907+0000","last_became_active":"2024-09-15T22:56:21.037053+0000","last_became_peered":"2024-09-15T22:56:21.037053+0000","last_unstale":"2024-09-15T22:56:22.050907+0000","last_undegraded":"2024-09-15T22:56:22.050907+0000","last_fullsized":"2024-09-15T22:56:22.050907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050656+0000","last_change":"2024-09-15T22:56:21.025979+0000","last_active":"2024-09-15T22:56:22.050656+0000","last_peered":"2024-09-15T22:56:22.050656+0000","last_clean":"2024-09-15T22:56:22.050656+0000","last_became_active":"2024-09-15T22:56:21.025244+0000","last_became_peered":"2024-09-15T22:56:21.025244+0000","last_unstale":"2024-09-15T22:56:22.050656+0000","last_undegraded":"2024-09-15T22:56:22.050656+0000","last_fullsized":"2024-09-15T22:56:22.050656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009445+0000","last_change":"2024-09-15T22:56:21.048891+0000","last_active":"2024-09-15T22:56:22.009445+0000","last_peered":"2024-09-15T22:56:22.009445+0000","last_clean":"2024-09-15T22:56:22.009445+0000","last_became_active":"2024-09-15T22:56:21.047867+0000","last_became_peered":"2024-09-15T22:56:21.047867+0000","last_unstale":"2024-09-15T22:56:22.009445+0000","last_undegraded":"2024-09-15T22:56:22.009445+0000","last_fullsized":"2024-09-15T22:56:22.009445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217499+0000","last_change":"2024-09-15T22:56:21.040543+0000","last_active":"2024-09-15T22:56:22.217499+0000","last_peered":"2024-09-15T22:56:22.217499+0000","last_clean":"2024-09-15T22:56:22.217499+0000","last_became_active":"2024-09-15T22:56:21.037513+0000","last_became_peered":"2024-09-15T22:56:21.037513+0000","last_unstale":"2024-09-15T22:56:22.217499+0000","last_undegraded":"2024-09-15T22:56:22.217499+0000","last_fullsized":"2024-09-15T22:56:22.217499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141539+0000","last_change":"2024-09-15T22:56:21.030445+0000","last_active":"2024-09-15T22:56:22.141539+0000","last_peered":"2024-09-15T22:56:22.141539+0000","last_clean":"2024-09-15T22:56:22.141539+0000","last_became_active":"2024-09-15T22:56:21.029183+0000","last_became_peered":"2024-09-15T22:56:21.029183+0000","last_unstale":"2024-09-15T22:56:22.141539+0000","last_undegraded":"2024-09-15T22:56:22.141539+0000","last_fullsized":"2024-09-15T22:56:22.141539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:25.498214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003208+0000","last_change":"2024-09-15T22:56:21.060226+0000","last_active":"2024-09-15T22:56:22.003208+0000","last_peered":"2024-09-15T22:56:22.003208+0000","last_clean":"2024-09-15T22:56:22.003208+0000","last_became_active":"2024-09-15T22:56:21.059278+0000","last_became_peered":"2024-09-15T22:56:21.059278+0000","last_unstale":"2024-09-15T22:56:22.003208+0000","last_undegraded":"2024-09-15T22:56:22.003208+0000","last_fullsized":"2024-09-15T22:56:22.003208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005250+0000","last_change":"2024-09-15T22:56:21.031563+0000","last_active":"2024-09-15T22:56:22.005250+0000","last_peered":"2024-09-15T22:56:22.005250+0000","last_clean":"2024-09-15T22:56:22.005250+0000","last_became_active":"2024-09-15T22:56:21.030766+0000","last_became_peered":"2024-09-15T22:56:21.030766+0000","last_unstale":"2024-09-15T22:56:22.005250+0000","last_undegraded":"2024-09-15T22:56:22.005250+0000","last_fullsized":"2024-09-15T22:56:22.005250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006836+0000","last_change":"2024-09-15T22:56:21.027156+0000","last_active":"2024-09-15T22:56:22.006836+0000","last_peered":"2024-09-15T22:56:22.006836+0000","last_clean":"2024-09-15T22:56:22.006836+0000","last_became_active":"2024-09-15T22:56:21.026524+0000","last_became_peered":"2024-09-15T22:56:21.026524+0000","last_unstale":"2024-09-15T22:56:22.006836+0000","last_undegraded":"2024-09-15T22:56:22.006836+0000","last_fullsized":"2024-09-15T22:56:22.006836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179333+0000","last_change":"2024-09-15T22:56:21.026616+0000","last_active":"2024-09-15T22:56:23.179333+0000","last_peered":"2024-09-15T22:56:23.179333+0000","last_clean":"2024-09-15T22:56:23.179333+0000","last_became_active":"2024-09-15T22:56:21.025720+0000","last_became_peered":"2024-09-15T22:56:21.025720+0000","last_unstale":"2024-09-15T22:56:23.179333+0000","last_undegraded":"2024-09-15T22:56:23.179333+0000","last_fullsized":"2024-09-15T22:56:23.179333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180750+0000","last_change":"2024-09-15T22:56:21.050095+0000","last_active":"2024-09-15T22:56:23.180750+0000","last_peered":"2024-09-15T22:56:23.180750+0000","last_clean":"2024-09-15T22:56:23.180750+0000","last_became_active":"2024-09-15T22:56:21.049818+0000","last_became_peered":"2024-09-15T22:56:21.049818+0000","last_unstale":"2024-09-15T22:56:23.180750+0000","last_undegraded":"2024-09-15T22:56:23.180750+0000","last_fullsized":"2024-09-15T22:56:23.180750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:38.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051010+0000","last_change":"2024-09-15T22:56:21.060371+0000","last_active":"2024-09-15T22:56:22.051010+0000","last_peered":"2024-09-15T22:56:22.051010+0000","last_clean":"2024-09-15T22:56:22.051010+0000","last_became_active":"2024-09-15T22:56:21.060056+0000","last_became_peered":"2024-09-15T22:56:21.060056+0000","last_unstale":"2024-09-15T22:56:22.051010+0000","last_undegraded":"2024-09-15T22:56:22.051010+0000","last_fullsized":"2024-09-15T22:56:22.051010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141782+0000","last_change":"2024-09-15T22:56:21.032143+0000","last_active":"2024-09-15T22:56:22.141782+0000","last_peered":"2024-09-15T22:56:22.141782+0000","last_clean":"2024-09-15T22:56:22.141782+0000","last_became_active":"2024-09-15T22:56:21.029384+0000","last_became_peered":"2024-09-15T22:56:21.029384+0000","last_unstale":"2024-09-15T22:56:22.141782+0000","last_undegraded":"2024-09-15T22:56:22.141782+0000","last_fullsized":"2024-09-15T22:56:22.141782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006884+0000","last_change":"2024-09-15T22:56:21.033531+0000","last_active":"2024-09-15T22:56:22.006884+0000","last_peered":"2024-09-15T22:56:22.006884+0000","last_clean":"2024-09-15T22:56:22.006884+0000","last_became_active":"2024-09-15T22:56:21.028976+0000","last_became_peered":"2024-09-15T22:56:21.028976+0000","last_unstale":"2024-09-15T22:56:22.006884+0000","last_undegraded":"2024-09-15T22:56:22.006884+0000","last_fullsized":"2024-09-15T22:56:22.006884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216872+0000","last_change":"2024-09-15T22:56:21.062713+0000","last_active":"2024-09-15T22:56:22.216872+0000","last_peered":"2024-09-15T22:56:22.216872+0000","last_clean":"2024-09-15T22:56:22.216872+0000","last_became_active":"2024-09-15T22:56:21.062258+0000","last_became_peered":"2024-09-15T22:56:21.062258+0000","last_unstale":"2024-09-15T22:56:22.216872+0000","last_undegraded":"2024-09-15T22:56:22.216872+0000","last_fullsized":"2024-09-15T22:56:22.216872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005697+0000","last_change":"2024-09-15T22:56:21.036717+0000","last_active":"2024-09-15T22:56:22.005697+0000","last_peered":"2024-09-15T22:56:22.005697+0000","last_clean":"2024-09-15T22:56:22.005697+0000","last_became_active":"2024-09-15T22:56:21.035818+0000","last_became_peered":"2024-09-15T22:56:21.035818+0000","last_unstale":"2024-09-15T22:56:22.005697+0000","last_undegraded":"2024-09-15T22:56:22.005697+0000","last_fullsized":"2024-09-15T22:56:22.005697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218073+0000","last_change":"2024-09-15T22:56:21.050243+0000","last_active":"2024-09-15T22:56:22.218073+0000","last_peered":"2024-09-15T22:56:22.218073+0000","last_clean":"2024-09-15T22:56:22.218073+0000","last_became_active":"2024-09-15T22:56:21.049811+0000","last_became_peered":"2024-09-15T22:56:21.049811+0000","last_unstale":"2024-09-15T22:56:22.218073+0000","last_undegraded":"2024-09-15T22:56:22.218073+0000","last_fullsized":"2024-09-15T22:56:22.218073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051051+0000","last_change":"2024-09-15T22:56:21.034983+0000","last_active":"2024-09-15T22:56:22.051051+0000","last_peered":"2024-09-15T22:56:22.051051+0000","last_clean":"2024-09-15T22:56:22.051051+0000","last_became_active":"2024-09-15T22:56:21.034274+0000","last_became_peered":"2024-09-15T22:56:21.034274+0000","last_unstale":"2024-09-15T22:56:22.051051+0000","last_undegraded":"2024-09-15T22:56:22.051051+0000","last_fullsized":"2024-09-15T22:56:22.051051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003271+0000","last_change":"2024-09-15T22:56:21.039395+0000","last_active":"2024-09-15T22:56:22.003271+0000","last_peered":"2024-09-15T22:56:22.003271+0000","last_clean":"2024-09-15T22:56:22.003271+0000","last_became_active":"2024-09-15T22:56:21.039113+0000","last_became_peered":"2024-09-15T22:56:21.039113+0000","last_unstale":"2024-09-15T22:56:22.003271+0000","last_undegraded":"2024-09-15T22:56:22.003271+0000","last_fullsized":"2024-09-15T22:56:22.003271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217763+0000","last_change":"2024-09-15T22:56:21.062629+0000","last_active":"2024-09-15T22:56:22.217763+0000","last_peered":"2024-09-15T22:56:22.217763+0000","last_clean":"2024-09-15T22:56:22.217763+0000","last_became_active":"2024-09-15T22:56:21.062301+0000","last_became_peered":"2024-09-15T22:56:21.062301+0000","last_unstale":"2024-09-15T22:56:22.217763+0000","last_undegraded":"2024-09-15T22:56:22.217763+0000","last_fullsized":"2024-09-15T22:56:22.217763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142003+0000","last_change":"2024-09-15T22:56:21.036927+0000","last_active":"2024-09-15T22:56:22.142003+0000","last_peered":"2024-09-15T22:56:22.142003+0000","last_clean":"2024-09-15T22:56:22.142003+0000","last_became_active":"2024-09-15T22:56:21.036612+0000","last_became_peered":"2024-09-15T22:56:21.036612+0000","last_unstale":"2024-09-15T22:56:22.142003+0000","last_undegraded":"2024-09-15T22:56:22.142003+0000","last_fullsized":"2024-09-15T22:56:22.142003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007140+0000","last_change":"2024-09-15T22:56:21.039825+0000","last_active":"2024-09-15T22:56:22.007140+0000","last_peered":"2024-09-15T22:56:22.007140+0000","last_clean":"2024-09-15T22:56:22.007140+0000","last_became_active":"2024-09-15T22:56:21.038388+0000","last_became_peered":"2024-09-15T22:56:21.038388+0000","last_unstale":"2024-09-15T22:56:22.007140+0000","last_undegraded":"2024-09-15T22:56:22.007140+0000","last_fullsized":"2024-09-15T22:56:22.007140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179235+0000","last_change":"2024-09-15T22:56:21.018597+0000","last_active":"2024-09-15T22:56:23.179235+0000","last_peered":"2024-09-15T22:56:23.179235+0000","last_clean":"2024-09-15T22:56:23.179235+0000","last_became_active":"2024-09-15T22:56:21.017870+0000","last_became_peered":"2024-09-15T22:56:21.017870+0000","last_unstale":"2024-09-15T22:56:23.179235+0000","last_undegraded":"2024-09-15T22:56:23.179235+0000","last_fullsized":"2024-09-15T22:56:23.179235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050354+0000","last_change":"2024-09-15T22:56:21.035519+0000","last_active":"2024-09-15T22:56:22.050354+0000","last_peered":"2024-09-15T22:56:22.050354+0000","last_clean":"2024-09-15T22:56:22.050354+0000","last_became_active":"2024-09-15T22:56:21.033628+0000","last_became_peered":"2024-09-15T22:56:21.033628+0000","last_unstale":"2024-09-15T22:56:22.050354+0000","last_undegraded":"2024-09-15T22:56:22.050354+0000","last_fullsized":"2024-09-15T22:56:22.050354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008297+0000","last_change":"2024-09-15T22:56:21.042927+0000","last_active":"2024-09-15T22:56:22.008297+0000","last_peered":"2024-09-15T22:56:22.008297+0000","last_clean":"2024-09-15T22:56:22.008297+0000","last_became_active":"2024-09-15T22:56:21.042371+0000","last_became_peered":"2024-09-15T22:56:21.042371+0000","last_unstale":"2024-09-15T22:56:22.008297+0000","last_undegraded":"2024-09-15T22:56:22.008297+0000","last_fullsized":"2024-09-15T22:56:22.008297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:47.722424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217741+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:22.217741+0000","last_peered":"2024-09-15T22:56:22.217741+0000","last_clean":"2024-09-15T22:56:22.217741+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:22.217741+0000","last_undegraded":"2024-09-15T22:56:22.217741+0000","last_fullsized":"2024-09-15T22:56:22.217741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142010+0000","last_change":"2024-09-15T22:56:21.051815+0000","last_active":"2024-09-15T22:56:22.142010+0000","last_peered":"2024-09-15T22:56:22.142010+0000","last_clean":"2024-09-15T22:56:22.142010+0000","last_became_active":"2024-09-15T22:56:21.051533+0000","last_became_peered":"2024-09-15T22:56:21.051533+0000","last_unstale":"2024-09-15T22:56:22.142010+0000","last_undegraded":"2024-09-15T22:56:22.142010+0000","last_fullsized":"2024-09-15T22:56:22.142010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050312+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:22.050312+0000","last_peered":"2024-09-15T22:56:22.050312+0000","last_clean":"2024-09-15T22:56:22.050312+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:22.050312+0000","last_undegraded":"2024-09-15T22:56:22.050312+0000","last_fullsized":"2024-09-15T22:56:22.050312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217152+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:22.217152+0000","last_peered":"2024-09-15T22:56:22.217152+0000","last_clean":"2024-09-15T22:56:22.217152+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:22.217152+0000","last_undegraded":"2024-09-15T22:56:22.217152+0000","last_fullsized":"2024-09-15T22:56:22.217152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216948+0000","last_change":"2024-09-15T22:56:21.037092+0000","last_active":"2024-09-15T22:56:22.216948+0000","last_peered":"2024-09-15T22:56:22.216948+0000","last_clean":"2024-09-15T22:56:22.216948+0000","last_became_active":"2024-09-15T22:56:21.036262+0000","last_became_peered":"2024-09-15T22:56:21.036262+0000","last_unstale":"2024-09-15T22:56:22.216948+0000","last_undegraded":"2024-09-15T22:56:22.216948+0000","last_fullsized":"2024-09-15T22:56:22.216948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005951+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:22.005951+0000","last_peered":"2024-09-15T22:56:22.005951+0000","last_clean":"2024-09-15T22:56:22.005951+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:22.005951+0000","last_undegraded":"2024-09-15T22:56:22.005951+0000","last_fullsized":"2024-09-15T22:56:22.005951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003006+0000","last_change":"2024-09-15T22:56:21.038747+0000","last_active":"2024-09-15T22:56:22.003006+0000","last_peered":"2024-09-15T22:56:22.003006+0000","last_clean":"2024-09-15T22:56:22.003006+0000","last_became_active":"2024-09-15T22:56:21.038452+0000","last_became_peered":"2024-09-15T22:56:21.038452+0000","last_unstale":"2024-09-15T22:56:22.003006+0000","last_undegraded":"2024-09-15T22:56:22.003006+0000","last_fullsized":"2024-09-15T22:56:22.003006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050686+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:22.050686+0000","last_peered":"2024-09-15T22:56:22.050686+0000","last_clean":"2024-09-15T22:56:22.050686+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:22.050686+0000","last_undegraded":"2024-09-15T22:56:22.050686+0000","last_fullsized":"2024-09-15T22:56:22.050686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005757+0000","last_change":"2024-09-15T22:56:21.025007+0000","last_active":"2024-09-15T22:56:22.005757+0000","last_peered":"2024-09-15T22:56:22.005757+0000","last_clean":"2024-09-15T22:56:22.005757+0000","last_became_active":"2024-09-15T22:56:21.023970+0000","last_became_peered":"2024-09-15T22:56:21.023970+0000","last_unstale":"2024-09-15T22:56:22.005757+0000","last_undegraded":"2024-09-15T22:56:22.005757+0000","last_fullsized":"2024-09-15T22:56:22.005757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005763+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:22.005763+0000","last_peered":"2024-09-15T22:56:22.005763+0000","last_clean":"2024-09-15T22:56:22.005763+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:22.005763+0000","last_undegraded":"2024-09-15T22:56:22.005763+0000","last_fullsized":"2024-09-15T22:56:22.005763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142513+0000","last_change":"2024-09-15T22:56:21.029548+0000","last_active":"2024-09-15T22:56:22.142513+0000","last_peered":"2024-09-15T22:56:22.142513+0000","last_clean":"2024-09-15T22:56:22.142513+0000","last_became_active":"2024-09-15T22:56:21.028802+0000","last_became_peered":"2024-09-15T22:56:21.028802+0000","last_unstale":"2024-09-15T22:56:22.142513+0000","last_undegraded":"2024-09-15T22:56:22.142513+0000","last_fullsized":"2024-09-15T22:56:22.142513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003341+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:22.003341+0000","last_peered":"2024-09-15T22:56:22.003341+0000","last_clean":"2024-09-15T22:56:22.003341+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:22.003341+0000","last_undegraded":"2024-09-15T22:56:22.003341+0000","last_fullsized":"2024-09-15T22:56:22.003341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009002+0000","last_change":"2024-09-15T22:56:21.055834+0000","last_active":"2024-09-15T22:56:22.009002+0000","last_peered":"2024-09-15T22:56:22.009002+0000","last_clean":"2024-09-15T22:56:22.009002+0000","last_became_active":"2024-09-15T22:56:21.049855+0000","last_became_peered":"2024-09-15T22:56:21.049855+0000","last_unstale":"2024-09-15T22:56:22.009002+0000","last_undegraded":"2024-09-15T22:56:22.009002+0000","last_fullsized":"2024-09-15T22:56:22.009002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:11.763410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050975+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:22.050975+0000","last_peered":"2024-09-15T22:56:22.050975+0000","last_clean":"2024-09-15T22:56:22.050975+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:22.050975+0000","last_undegraded":"2024-09-15T22:56:22.050975+0000","last_fullsized":"2024-09-15T22:56:22.050975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180006+0000","last_change":"2024-09-15T22:56:21.046560+0000","last_active":"2024-09-15T22:56:23.180006+0000","last_peered":"2024-09-15T22:56:23.180006+0000","last_clean":"2024-09-15T22:56:23.180006+0000","last_became_active":"2024-09-15T22:56:21.045861+0000","last_became_peered":"2024-09-15T22:56:21.045861+0000","last_unstale":"2024-09-15T22:56:23.180006+0000","last_undegraded":"2024-09-15T22:56:23.180006+0000","last_fullsized":"2024-09-15T22:56:23.180006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142150+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:22.142150+0000","last_peered":"2024-09-15T22:56:22.142150+0000","last_clean":"2024-09-15T22:56:22.142150+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:22.142150+0000","last_undegraded":"2024-09-15T22:56:22.142150+0000","last_fullsized":"2024-09-15T22:56:22.142150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141682+0000","last_change":"2024-09-15T22:56:21.030324+0000","last_active":"2024-09-15T22:56:22.141682+0000","last_peered":"2024-09-15T22:56:22.141682+0000","last_clean":"2024-09-15T22:56:22.141682+0000","last_became_active":"2024-09-15T22:56:21.029364+0000","last_became_peered":"2024-09-15T22:56:21.029364+0000","last_unstale":"2024-09-15T22:56:22.141682+0000","last_undegraded":"2024-09-15T22:56:22.141682+0000","last_fullsized":"2024-09-15T22:56:22.141682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007313+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:22.007313+0000","last_peered":"2024-09-15T22:56:22.007313+0000","last_clean":"2024-09-15T22:56:22.007313+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:22.007313+0000","last_undegraded":"2024-09-15T22:56:22.007313+0000","last_fullsized":"2024-09-15T22:56:22.007313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180348+0000","last_change":"2024-09-15T22:56:21.059175+0000","last_active":"2024-09-15T22:56:23.180348+0000","last_peered":"2024-09-15T22:56:23.180348+0000","last_clean":"2024-09-15T22:56:23.180348+0000","last_became_active":"2024-09-15T22:56:21.058849+0000","last_became_peered":"2024-09-15T22:56:21.058849+0000","last_unstale":"2024-09-15T22:56:23.180348+0000","last_undegraded":"2024-09-15T22:56:23.180348+0000","last_fullsized":"2024-09-15T22:56:23.180348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050178+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:22.050178+0000","last_peered":"2024-09-15T22:56:22.050178+0000","last_clean":"2024-09-15T22:56:22.050178+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:22.050178+0000","last_undegraded":"2024-09-15T22:56:22.050178+0000","last_fullsized":"2024-09-15T22:56:22.050178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050382+0000","last_change":"2024-09-15T22:56:21.034329+0000","last_active":"2024-09-15T22:56:22.050382+0000","last_peered":"2024-09-15T22:56:22.050382+0000","last_clean":"2024-09-15T22:56:22.050382+0000","last_became_active":"2024-09-15T22:56:21.032155+0000","last_became_peered":"2024-09-15T22:56:21.032155+0000","last_unstale":"2024-09-15T22:56:22.050382+0000","last_undegraded":"2024-09-15T22:56:22.050382+0000","last_fullsized":"2024-09-15T22:56:22.050382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179149+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:23.179149+0000","last_peered":"2024-09-15T22:56:23.179149+0000","last_clean":"2024-09-15T22:56:23.179149+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:23.179149+0000","last_undegraded":"2024-09-15T22:56:23.179149+0000","last_fullsized":"2024-09-15T22:56:23.179149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179693+0000","last_change":"2024-09-15T22:56:21.060727+0000","last_active":"2024-09-15T22:56:23.179693+0000","last_peered":"2024-09-15T22:56:23.179693+0000","last_clean":"2024-09-15T22:56:23.179693+0000","last_became_active":"2024-09-15T22:56:21.060316+0000","last_became_peered":"2024-09-15T22:56:21.060316+0000","last_unstale":"2024-09-15T22:56:23.179693+0000","last_undegraded":"2024-09-15T22:56:23.179693+0000","last_fullsized":"2024-09-15T22:56:23.179693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009262+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:22.009262+0000","last_peered":"2024-09-15T22:56:22.009262+0000","last_clean":"2024-09-15T22:56:22.009262+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:22.009262+0000","last_undegraded":"2024-09-15T22:56:22.009262+0000","last_fullsized":"2024-09-15T22:56:22.009262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180646+0000","last_change":"2024-09-15T22:56:21.061277+0000","last_active":"2024-09-15T22:56:23.180646+0000","last_peered":"2024-09-15T22:56:23.180646+0000","last_clean":"2024-09-15T22:56:23.180646+0000","last_became_active":"2024-09-15T22:56:21.061012+0000","last_became_peered":"2024-09-15T22:56:21.061012+0000","last_unstale":"2024-09-15T22:56:23.180646+0000","last_undegraded":"2024-09-15T22:56:23.180646+0000","last_fullsized":"2024-09-15T22:56:23.180646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.747289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179357+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:23.179357+0000","last_peered":"2024-09-15T22:56:23.179357+0000","last_clean":"2024-09-15T22:56:23.179357+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:23.179357+0000","last_undegraded":"2024-09-15T22:56:23.179357+0000","last_fullsized":"2024-09-15T22:56:23.179357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.181081+0000","last_change":"2024-09-15T22:56:21.061243+0000","last_active":"2024-09-15T22:56:23.181081+0000","last_peered":"2024-09-15T22:56:23.181081+0000","last_clean":"2024-09-15T22:56:23.181081+0000","last_became_active":"2024-09-15T22:56:21.060909+0000","last_became_peered":"2024-09-15T22:56:21.060909+0000","last_unstale":"2024-09-15T22:56:23.181081+0000","last_undegraded":"2024-09-15T22:56:23.181081+0000","last_fullsized":"2024-09-15T22:56:23.181081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:42.598011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003379+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:22.003379+0000","last_peered":"2024-09-15T22:56:22.003379+0000","last_clean":"2024-09-15T22:56:22.003379+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:22.003379+0000","last_undegraded":"2024-09-15T22:56:22.003379+0000","last_fullsized":"2024-09-15T22:56:22.003379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005819+0000","last_change":"2024-09-15T22:56:21.037223+0000","last_active":"2024-09-15T22:56:22.005819+0000","last_peered":"2024-09-15T22:56:22.005819+0000","last_clean":"2024-09-15T22:56:22.005819+0000","last_became_active":"2024-09-15T22:56:21.036206+0000","last_became_peered":"2024-09-15T22:56:21.036206+0000","last_unstale":"2024-09-15T22:56:22.005819+0000","last_undegraded":"2024-09-15T22:56:22.005819+0000","last_fullsized":"2024-09-15T22:56:22.005819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179520+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:23.179520+0000","last_peered":"2024-09-15T22:56:23.179520+0000","last_clean":"2024-09-15T22:56:23.179520+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:23.179520+0000","last_undegraded":"2024-09-15T22:56:23.179520+0000","last_fullsized":"2024-09-15T22:56:23.179520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180199+0000","last_change":"2024-09-15T22:56:21.046827+0000","last_active":"2024-09-15T22:56:23.180199+0000","last_peered":"2024-09-15T22:56:23.180199+0000","last_clean":"2024-09-15T22:56:23.180199+0000","last_became_active":"2024-09-15T22:56:21.046257+0000","last_became_peered":"2024-09-15T22:56:21.046257+0000","last_unstale":"2024-09-15T22:56:23.180199+0000","last_undegraded":"2024-09-15T22:56:23.180199+0000","last_fullsized":"2024-09-15T22:56:23.180199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179789+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:23.179789+0000","last_peered":"2024-09-15T22:56:23.179789+0000","last_clean":"2024-09-15T22:56:23.179789+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:23.179789+0000","last_undegraded":"2024-09-15T22:56:23.179789+0000","last_fullsized":"2024-09-15T22:56:23.179789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005089+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:22.005089+0000","last_peered":"2024-09-15T22:56:22.005089+0000","last_clean":"2024-09-15T22:56:22.005089+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:22.005089+0000","last_undegraded":"2024-09-15T22:56:22.005089+0000","last_fullsized":"2024-09-15T22:56:22.005089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217092+0000","last_change":"2024-09-15T22:56:21.037507+0000","last_active":"2024-09-15T22:56:22.217092+0000","last_peered":"2024-09-15T22:56:22.217092+0000","last_clean":"2024-09-15T22:56:22.217092+0000","last_became_active":"2024-09-15T22:56:21.036694+0000","last_became_peered":"2024-09-15T22:56:21.036694+0000","last_unstale":"2024-09-15T22:56:22.217092+0000","last_undegraded":"2024-09-15T22:56:22.217092+0000","last_fullsized":"2024-09-15T22:56:22.217092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179425+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:23.179425+0000","last_peered":"2024-09-15T22:56:23.179425+0000","last_clean":"2024-09-15T22:56:23.179425+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:23.179425+0000","last_undegraded":"2024-09-15T22:56:23.179425+0000","last_fullsized":"2024-09-15T22:56:23.179425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141425+0000","last_change":"2024-09-15T22:56:21.059613+0000","last_active":"2024-09-15T22:56:22.141425+0000","last_peered":"2024-09-15T22:56:22.141425+0000","last_clean":"2024-09-15T22:56:22.141425+0000","last_became_active":"2024-09-15T22:56:21.059232+0000","last_became_peered":"2024-09-15T22:56:21.059232+0000","last_unstale":"2024-09-15T22:56:22.141425+0000","last_undegraded":"2024-09-15T22:56:22.141425+0000","last_fullsized":"2024-09-15T22:56:22.141425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:27.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179315+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:23.179315+0000","last_peered":"2024-09-15T22:56:23.179315+0000","last_clean":"2024-09-15T22:56:23.179315+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:23.179315+0000","last_undegraded":"2024-09-15T22:56:23.179315+0000","last_fullsized":"2024-09-15T22:56:23.179315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003288+0000","last_change":"2024-09-15T22:56:21.025917+0000","last_active":"2024-09-15T22:56:22.003288+0000","last_peered":"2024-09-15T22:56:22.003288+0000","last_clean":"2024-09-15T22:56:22.003288+0000","last_became_active":"2024-09-15T22:56:21.024942+0000","last_became_peered":"2024-09-15T22:56:21.024942+0000","last_unstale":"2024-09-15T22:56:22.003288+0000","last_undegraded":"2024-09-15T22:56:22.003288+0000","last_fullsized":"2024-09-15T22:56:22.003288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007443+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:22.007443+0000","last_peered":"2024-09-15T22:56:22.007443+0000","last_clean":"2024-09-15T22:56:22.007443+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:22.007443+0000","last_undegraded":"2024-09-15T22:56:22.007443+0000","last_fullsized":"2024-09-15T22:56:22.007443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008636+0000","last_change":"2024-09-15T22:56:21.048376+0000","last_active":"2024-09-15T22:56:22.008636+0000","last_peered":"2024-09-15T22:56:22.008636+0000","last_clean":"2024-09-15T22:56:22.008636+0000","last_became_active":"2024-09-15T22:56:21.044757+0000","last_became_peered":"2024-09-15T22:56:21.044757+0000","last_unstale":"2024-09-15T22:56:22.008636+0000","last_undegraded":"2024-09-15T22:56:22.008636+0000","last_fullsized":"2024-09-15T22:56:22.008636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004374+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:22.004374+0000","last_peered":"2024-09-15T22:56:22.004374+0000","last_clean":"2024-09-15T22:56:22.004374+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:22.004374+0000","last_undegraded":"2024-09-15T22:56:22.004374+0000","last_fullsized":"2024-09-15T22:56:22.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006284+0000","last_change":"2024-09-15T22:56:21.037003+0000","last_active":"2024-09-15T22:56:22.006284+0000","last_peered":"2024-09-15T22:56:22.006284+0000","last_clean":"2024-09-15T22:56:22.006284+0000","last_became_active":"2024-09-15T22:56:21.036088+0000","last_became_peered":"2024-09-15T22:56:21.036088+0000","last_unstale":"2024-09-15T22:56:22.006284+0000","last_undegraded":"2024-09-15T22:56:22.006284+0000","last_fullsized":"2024-09-15T22:56:22.006284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180792+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:23.180792+0000","last_peered":"2024-09-15T22:56:23.180792+0000","last_clean":"2024-09-15T22:56:23.180792+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:23.180792+0000","last_undegraded":"2024-09-15T22:56:23.180792+0000","last_fullsized":"2024-09-15T22:56:23.180792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:51.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004381+0000","last_change":"2024-09-15T22:56:21.027999+0000","last_active":"2024-09-15T22:56:22.004381+0000","last_peered":"2024-09-15T22:56:22.004381+0000","last_clean":"2024-09-15T22:56:22.004381+0000","last_became_active":"2024-09-15T22:56:21.027045+0000","last_became_peered":"2024-09-15T22:56:21.027045+0000","last_unstale":"2024-09-15T22:56:22.004381+0000","last_undegraded":"2024-09-15T22:56:22.004381+0000","last_fullsized":"2024-09-15T22:56:22.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004145+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:22.004145+0000","last_peered":"2024-09-15T22:56:22.004145+0000","last_clean":"2024-09-15T22:56:22.004145+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:22.004145+0000","last_undegraded":"2024-09-15T22:56:22.004145+0000","last_fullsized":"2024-09-15T22:56:22.004145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218282+0000","last_change":"2024-09-15T22:56:21.047660+0000","last_active":"2024-09-15T22:56:22.218282+0000","last_peered":"2024-09-15T22:56:22.218282+0000","last_clean":"2024-09-15T22:56:22.218282+0000","last_became_active":"2024-09-15T22:56:21.046792+0000","last_became_peered":"2024-09-15T22:56:21.046792+0000","last_unstale":"2024-09-15T22:56:22.218282+0000","last_undegraded":"2024-09-15T22:56:22.218282+0000","last_fullsized":"2024-09-15T22:56:22.218282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050772+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:22.050772+0000","last_peered":"2024-09-15T22:56:22.050772+0000","last_clean":"2024-09-15T22:56:22.050772+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:22.050772+0000","last_undegraded":"2024-09-15T22:56:22.050772+0000","last_fullsized":"2024-09-15T22:56:22.050772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142574+0000","last_change":"2024-09-15T22:56:21.023902+0000","last_active":"2024-09-15T22:56:22.142574+0000","last_peered":"2024-09-15T22:56:22.142574+0000","last_clean":"2024-09-15T22:56:22.142574+0000","last_became_active":"2024-09-15T22:56:21.022501+0000","last_became_peered":"2024-09-15T22:56:21.022501+0000","last_unstale":"2024-09-15T22:56:22.142574+0000","last_undegraded":"2024-09-15T22:56:22.142574+0000","last_fullsized":"2024-09-15T22:56:22.142574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179422+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:23.179422+0000","last_peered":"2024-09-15T22:56:23.179422+0000","last_clean":"2024-09-15T22:56:23.179422+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:23.179422+0000","last_undegraded":"2024-09-15T22:56:23.179422+0000","last_fullsized":"2024-09-15T22:56:23.179422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008423+0000","last_change":"2024-09-15T22:56:21.057092+0000","last_active":"2024-09-15T22:56:22.008423+0000","last_peered":"2024-09-15T22:56:22.008423+0000","last_clean":"2024-09-15T22:56:22.008423+0000","last_became_active":"2024-09-15T22:56:21.044676+0000","last_became_peered":"2024-09-15T22:56:21.044676+0000","last_unstale":"2024-09-15T22:56:22.008423+0000","last_undegraded":"2024-09-15T22:56:22.008423+0000","last_fullsized":"2024-09-15T22:56:22.008423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003472+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:22.003472+0000","last_peered":"2024-09-15T22:56:22.003472+0000","last_clean":"2024-09-15T22:56:22.003472+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:22.003472+0000","last_undegraded":"2024-09-15T22:56:22.003472+0000","last_fullsized":"2024-09-15T22:56:22.003472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217176+0000","last_change":"2024-09-15T22:56:21.035548+0000","last_active":"2024-09-15T22:56:22.217176+0000","last_peered":"2024-09-15T22:56:22.217176+0000","last_clean":"2024-09-15T22:56:22.217176+0000","last_became_active":"2024-09-15T22:56:21.030034+0000","last_became_peered":"2024-09-15T22:56:21.030034+0000","last_unstale":"2024-09-15T22:56:22.217176+0000","last_undegraded":"2024-09-15T22:56:22.217176+0000","last_fullsized":"2024-09-15T22:56:22.217176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003541+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:22.003541+0000","last_peered":"2024-09-15T22:56:22.003541+0000","last_clean":"2024-09-15T22:56:22.003541+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:22.003541+0000","last_undegraded":"2024-09-15T22:56:22.003541+0000","last_fullsized":"2024-09-15T22:56:22.003541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217560+0000","last_change":"2024-09-15T22:56:21.036761+0000","last_active":"2024-09-15T22:56:22.217560+0000","last_peered":"2024-09-15T22:56:22.217560+0000","last_clean":"2024-09-15T22:56:22.217560+0000","last_became_active":"2024-09-15T22:56:21.036060+0000","last_became_peered":"2024-09-15T22:56:21.036060+0000","last_unstale":"2024-09-15T22:56:22.217560+0000","last_undegraded":"2024-09-15T22:56:22.217560+0000","last_fullsized":"2024-09-15T22:56:22.217560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180453+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:23.180453+0000","last_peered":"2024-09-15T22:56:23.180453+0000","last_clean":"2024-09-15T22:56:23.180453+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:23.180453+0000","last_undegraded":"2024-09-15T22:56:23.180453+0000","last_fullsized":"2024-09-15T22:56:23.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050392+0000","last_change":"2024-09-15T22:56:21.049096+0000","last_active":"2024-09-15T22:56:22.050392+0000","last_peered":"2024-09-15T22:56:22.050392+0000","last_clean":"2024-09-15T22:56:22.050392+0000","last_became_active":"2024-09-15T22:56:21.048786+0000","last_became_peered":"2024-09-15T22:56:21.048786+0000","last_unstale":"2024-09-15T22:56:22.050392+0000","last_undegraded":"2024-09-15T22:56:22.050392+0000","last_fullsized":"2024-09-15T22:56:22.050392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006067+0000","last_change":"2024-09-15T22:56:21.057906+0000","last_active":"2024-09-15T22:56:22.006067+0000","last_peered":"2024-09-15T22:56:22.006067+0000","last_clean":"2024-09-15T22:56:22.006067+0000","last_became_active":"2024-09-15T22:56:21.057525+0000","last_became_peered":"2024-09-15T22:56:21.057525+0000","last_unstale":"2024-09-15T22:56:22.006067+0000","last_undegraded":"2024-09-15T22:56:22.006067+0000","last_fullsized":"2024-09-15T22:56:22.006067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180598+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:23.180598+0000","last_peered":"2024-09-15T22:56:23.180598+0000","last_clean":"2024-09-15T22:56:23.180598+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:23.180598+0000","last_undegraded":"2024-09-15T22:56:23.180598+0000","last_fullsized":"2024-09-15T22:56:23.180598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.753562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005745+0000","last_change":"2024-09-15T22:56:21.058064+0000","last_active":"2024-09-15T22:56:22.005745+0000","last_peered":"2024-09-15T22:56:22.005745+0000","last_clean":"2024-09-15T22:56:22.005745+0000","last_became_active":"2024-09-15T22:56:21.057542+0000","last_became_peered":"2024-09-15T22:56:21.057542+0000","last_unstale":"2024-09-15T22:56:22.005745+0000","last_undegraded":"2024-09-15T22:56:22.005745+0000","last_fullsized":"2024-09-15T22:56:22.005745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180466+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:23.180466+0000","last_peered":"2024-09-15T22:56:23.180466+0000","last_clean":"2024-09-15T22:56:23.180466+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:23.180466+0000","last_undegraded":"2024-09-15T22:56:23.180466+0000","last_fullsized":"2024-09-15T22:56:23.180466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:31.596992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142530+0000","last_change":"2024-09-15T22:56:21.033186+0000","last_active":"2024-09-15T22:56:22.142530+0000","last_peered":"2024-09-15T22:56:22.142530+0000","last_clean":"2024-09-15T22:56:22.142530+0000","last_became_active":"2024-09-15T22:56:21.030711+0000","last_became_peered":"2024-09-15T22:56:21.030711+0000","last_unstale":"2024-09-15T22:56:22.142530+0000","last_undegraded":"2024-09-15T22:56:22.142530+0000","last_fullsized":"2024-09-15T22:56:22.142530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218077+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:22.218077+0000","last_peered":"2024-09-15T22:56:22.218077+0000","last_clean":"2024-09-15T22:56:22.218077+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:22.218077+0000","last_undegraded":"2024-09-15T22:56:22.218077+0000","last_fullsized":"2024-09-15T22:56:22.218077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217920+0000","last_change":"2024-09-15T22:56:21.063433+0000","last_active":"2024-09-15T22:56:22.217920+0000","last_peered":"2024-09-15T22:56:22.217920+0000","last_clean":"2024-09-15T22:56:22.217920+0000","last_became_active":"2024-09-15T22:56:21.062367+0000","last_became_peered":"2024-09-15T22:56:21.062367+0000","last_unstale":"2024-09-15T22:56:22.217920+0000","last_undegraded":"2024-09-15T22:56:22.217920+0000","last_fullsized":"2024-09-15T22:56:22.217920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142732+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:22.142732+0000","last_peered":"2024-09-15T22:56:22.142732+0000","last_clean":"2024-09-15T22:56:22.142732+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:22.142732+0000","last_undegraded":"2024-09-15T22:56:22.142732+0000","last_fullsized":"2024-09-15T22:56:22.142732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:29.564 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:29.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 Processor -- start 2024-09-15T22:56:29.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 -- start start 2024-09-15T22:56:29.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 0x7fa2640d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa2640b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa264074180 con 0x7fa26415e4f0 2024-09-15T22:56:29.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa2641629c0 con 0x7fa26415e110 2024-09-15T22:56:29.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa26a910640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa264162ca0 con 0x7fa2640b4380 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa268ead640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa2640b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa263fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 0x7fa2640d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa2637fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa26415e4f0 0x7fa264161f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:32936/0 (socket says 172.21.15.28:32936) 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa2637fe640 1 -- 172.21.15.28:0/3974574148 learned_addr learned my addr 172.21.15.28:0/3974574148 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa268ead640 1 -- 172.21.15.28:0/3974574148 >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 msgr2=0x7fa2640d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa268ead640 1 --2- 172.21.15.28:0/3974574148 >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 0x7fa2640d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa268ead640 1 -- 172.21.15.28:0/3974574148 >> v1:172.21.15.131:6789/0 conn(0x7fa26415e4f0 legacy=0x7fa264161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa268ead640 1 -- 172.21.15.28:0/3974574148 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2640d2470 con 0x7fa2640b4380 2024-09-15T22:56:29.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.696+0000 7fa263fff640 1 --2- 172.21.15.28:0/3974574148 >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 0x7fa2640d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:29.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa268ead640 1 --2- 172.21.15.28:0/3974574148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa2640b4810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009dc0 tx=0x7fa25c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e97f35479af352 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:29.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa262ffd640 1 -- 172.21.15.28:0/3974574148 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b2070 con 0x7fa2640b4380 2024-09-15T22:56:29.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa262ffd640 1 -- 172.21.15.28:0/3974574148 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c0a5920 con 0x7fa2640b4380 2024-09-15T22:56:29.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa262ffd640 1 -- 172.21.15.28:0/3974574148 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0a5cf0 con 0x7fa2640b4380 2024-09-15T22:56:29.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 -- 172.21.15.28:0/3974574148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 msgr2=0x7fa2640b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 --2- 172.21.15.28:0/3974574148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa2640b4810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009dc0 tx=0x7fa25c01c950 comp rx=0 tx=0).stop 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 -- 172.21.15.28:0/3974574148 shutdown_connections 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 --2- 172.21.15.28:0/3974574148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa2640b4810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 --2- 172.21.15.28:0/3974574148 >> v2:172.21.15.131:3300/0 conn(0x7fa26415e110 0x7fa2640d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 -- 172.21.15.28:0/3974574148 >> 172.21.15.28:0/3974574148 conn(0x7fa264067a00 msgr2=0x7fa264067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 -- 172.21.15.28:0/3974574148 shutdown_connections 2024-09-15T22:56:29.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.700+0000 7fa26a910640 1 -- 172.21.15.28:0/3974574148 wait complete. 2024-09-15T22:56:29.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 Processor -- start 2024-09-15T22:56:29.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- start start 2024-09-15T22:56:29.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa264151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26415e4f0 0x7fa264158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa26406db80 con 0x7fa26415e110 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa26406da00 con 0x7fa26415e4f0 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa26406dd00 con 0x7fa2640b4380 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34522/0 (socket says 172.21.15.28:34522) 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 -- 172.21.15.28:0/2906640263 learned_addr learned my addr 172.21.15.28:0/2906640263 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa268ead640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26415e4f0 0x7fa264158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa263fff640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa264151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 -- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 msgr2=0x7fa264151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa264151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 -- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26415e4f0 msgr2=0x7fa264158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26415e4f0 0x7fa264158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 -- 172.21.15.28:0/2906640263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2640cc570 con 0x7fa26415e110 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa263fff640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa264151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa2637fe640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c400 tx=0x7fa24c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c017070 con 0x7fa26415e110 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c005cf0 con 0x7fa26415e110 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2640cc850 con 0x7fa26415e110 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0072d0 con 0x7fa26415e110 2024-09-15T22:56:29.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2641561f0 con 0x7fa26415e110 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.704+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2640b4810 con 0x7fa26415e110 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.708+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa24c01a070 con 0x7fa26415e110 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.708+0000 7fa260ff9640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 0x7fa244069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.708+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa24c085840 con 0x7fa26415e110 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.708+0000 7fa263fff640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 0x7fa244069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:29.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.708+0000 7fa263fff640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 0x7fa244069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa254009bc0 tx=0x7fa254008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:29.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.712+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa24c055d10 con 0x7fa26415e110 2024-09-15T22:56:29.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.876+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa264160b50 con 0x7fa2440678c0 2024-09-15T22:56:29.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.880+0000 7fa260ff9640 1 -- 172.21.15.28:0/2906640263 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7fa264160b50 con 0x7fa2440678c0 2024-09-15T22:56:29.885 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:29.887 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 msgr2=0x7fa244069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 0x7fa244069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa254009bc0 tx=0x7fa254008040 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 msgr2=0x7fa2640ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c400 tx=0x7fa24c00c8c0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 shutdown_connections 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa2440678c0 0x7fa244069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa26415e4f0 0x7fa264158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa26415e110 0x7fa2640ce160 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 --2- 172.21.15.28:0/2906640263 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2640b4380 0x7fa264151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 >> 172.21.15.28:0/2906640263 conn(0x7fa264067a00 msgr2=0x7fa264067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 shutdown_connections 2024-09-15T22:56:29.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:29.884+0000 7fa26a910640 1 -- 172.21.15.28:0/2906640263 wait complete. 2024-09-15T22:56:29.904 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T22:56:29.869413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.868171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180547+0000","last_change":"2024-09-15T22:56:21.056451+0000","last_active":"2024-09-15T22:56:23.180547+0000","last_peered":"2024-09-15T22:56:23.180547+0000","last_clean":"2024-09-15T22:56:23.180547+0000","last_became_active":"2024-09-15T22:56:21.056145+0000","last_became_peered":"2024-09-15T22:56:21.056145+0000","last_unstale":"2024-09-15T22:56:23.180547+0000","last_undegraded":"2024-09-15T22:56:23.180547+0000","last_fullsized":"2024-09-15T22:56:23.180547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003947+0000","last_change":"2024-09-15T22:56:21.032126+0000","last_active":"2024-09-15T22:56:22.003947+0000","last_peered":"2024-09-15T22:56:22.003947+0000","last_clean":"2024-09-15T22:56:22.003947+0000","last_became_active":"2024-09-15T22:56:21.031366+0000","last_became_peered":"2024-09-15T22:56:21.031366+0000","last_unstale":"2024-09-15T22:56:22.003947+0000","last_undegraded":"2024-09-15T22:56:22.003947+0000","last_fullsized":"2024-09-15T22:56:22.003947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142427+0000","last_change":"2024-09-15T22:56:21.019102+0000","last_active":"2024-09-15T22:56:22.142427+0000","last_peered":"2024-09-15T22:56:22.142427+0000","last_clean":"2024-09-15T22:56:22.142427+0000","last_became_active":"2024-09-15T22:56:21.018279+0000","last_became_peered":"2024-09-15T22:56:21.018279+0000","last_unstale":"2024-09-15T22:56:22.142427+0000","last_undegraded":"2024-09-15T22:56:22.142427+0000","last_fullsized":"2024-09-15T22:56:22.142427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005366+0000","last_change":"2024-09-15T22:56:21.038401+0000","last_active":"2024-09-15T22:56:22.005366+0000","last_peered":"2024-09-15T22:56:22.005366+0000","last_clean":"2024-09-15T22:56:22.005366+0000","last_became_active":"2024-09-15T22:56:21.037254+0000","last_became_peered":"2024-09-15T22:56:21.037254+0000","last_unstale":"2024-09-15T22:56:22.005366+0000","last_undegraded":"2024-09-15T22:56:22.005366+0000","last_fullsized":"2024-09-15T22:56:22.005366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180159+0000","last_change":"2024-09-15T22:56:21.045620+0000","last_active":"2024-09-15T22:56:23.180159+0000","last_peered":"2024-09-15T22:56:23.180159+0000","last_clean":"2024-09-15T22:56:23.180159+0000","last_became_active":"2024-09-15T22:56:21.044268+0000","last_became_peered":"2024-09-15T22:56:21.044268+0000","last_unstale":"2024-09-15T22:56:23.180159+0000","last_undegraded":"2024-09-15T22:56:23.180159+0000","last_fullsized":"2024-09-15T22:56:23.180159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006657+0000","last_change":"2024-09-15T22:56:21.032910+0000","last_active":"2024-09-15T22:56:22.006657+0000","last_peered":"2024-09-15T22:56:22.006657+0000","last_clean":"2024-09-15T22:56:22.006657+0000","last_became_active":"2024-09-15T22:56:21.032121+0000","last_became_peered":"2024-09-15T22:56:21.032121+0000","last_unstale":"2024-09-15T22:56:22.006657+0000","last_undegraded":"2024-09-15T22:56:22.006657+0000","last_fullsized":"2024-09-15T22:56:22.006657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179615+0000","last_change":"2024-09-15T22:56:21.040858+0000","last_active":"2024-09-15T22:56:23.179615+0000","last_peered":"2024-09-15T22:56:23.179615+0000","last_clean":"2024-09-15T22:56:23.179615+0000","last_became_active":"2024-09-15T22:56:21.040118+0000","last_became_peered":"2024-09-15T22:56:21.040118+0000","last_unstale":"2024-09-15T22:56:23.179615+0000","last_undegraded":"2024-09-15T22:56:23.179615+0000","last_fullsized":"2024-09-15T22:56:23.179615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216724+0000","last_change":"2024-09-15T22:56:21.045328+0000","last_active":"2024-09-15T22:56:22.216724+0000","last_peered":"2024-09-15T22:56:22.216724+0000","last_clean":"2024-09-15T22:56:22.216724+0000","last_became_active":"2024-09-15T22:56:21.041149+0000","last_became_peered":"2024-09-15T22:56:21.041149+0000","last_unstale":"2024-09-15T22:56:22.216724+0000","last_undegraded":"2024-09-15T22:56:22.216724+0000","last_fullsized":"2024-09-15T22:56:22.216724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180976+0000","last_change":"2024-09-15T22:56:21.050262+0000","last_active":"2024-09-15T22:56:23.180976+0000","last_peered":"2024-09-15T22:56:23.180976+0000","last_clean":"2024-09-15T22:56:23.180976+0000","last_became_active":"2024-09-15T22:56:21.049947+0000","last_became_peered":"2024-09-15T22:56:21.049947+0000","last_unstale":"2024-09-15T22:56:23.180976+0000","last_undegraded":"2024-09-15T22:56:23.180976+0000","last_fullsized":"2024-09-15T22:56:23.180976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:10.140812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050907+0000","last_change":"2024-09-15T22:56:21.047268+0000","last_active":"2024-09-15T22:56:22.050907+0000","last_peered":"2024-09-15T22:56:22.050907+0000","last_clean":"2024-09-15T22:56:22.050907+0000","last_became_active":"2024-09-15T22:56:21.037053+0000","last_became_peered":"2024-09-15T22:56:21.037053+0000","last_unstale":"2024-09-15T22:56:22.050907+0000","last_undegraded":"2024-09-15T22:56:22.050907+0000","last_fullsized":"2024-09-15T22:56:22.050907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050656+0000","last_change":"2024-09-15T22:56:21.025979+0000","last_active":"2024-09-15T22:56:22.050656+0000","last_peered":"2024-09-15T22:56:22.050656+0000","last_clean":"2024-09-15T22:56:22.050656+0000","last_became_active":"2024-09-15T22:56:21.025244+0000","last_became_peered":"2024-09-15T22:56:21.025244+0000","last_unstale":"2024-09-15T22:56:22.050656+0000","last_undegraded":"2024-09-15T22:56:22.050656+0000","last_fullsized":"2024-09-15T22:56:22.050656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009445+0000","last_change":"2024-09-15T22:56:21.048891+0000","last_active":"2024-09-15T22:56:22.009445+0000","last_peered":"2024-09-15T22:56:22.009445+0000","last_clean":"2024-09-15T22:56:22.009445+0000","last_became_active":"2024-09-15T22:56:21.047867+0000","last_became_peered":"2024-09-15T22:56:21.047867+0000","last_unstale":"2024-09-15T22:56:22.009445+0000","last_undegraded":"2024-09-15T22:56:22.009445+0000","last_fullsized":"2024-09-15T22:56:22.009445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217499+0000","last_change":"2024-09-15T22:56:21.040543+0000","last_active":"2024-09-15T22:56:22.217499+0000","last_peered":"2024-09-15T22:56:22.217499+0000","last_clean":"2024-09-15T22:56:22.217499+0000","last_became_active":"2024-09-15T22:56:21.037513+0000","last_became_peered":"2024-09-15T22:56:21.037513+0000","last_unstale":"2024-09-15T22:56:22.217499+0000","last_undegraded":"2024-09-15T22:56:22.217499+0000","last_fullsized":"2024-09-15T22:56:22.217499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141539+0000","last_change":"2024-09-15T22:56:21.030445+0000","last_active":"2024-09-15T22:56:22.141539+0000","last_peered":"2024-09-15T22:56:22.141539+0000","last_clean":"2024-09-15T22:56:22.141539+0000","last_became_active":"2024-09-15T22:56:21.029183+0000","last_became_peered":"2024-09-15T22:56:21.029183+0000","last_unstale":"2024-09-15T22:56:22.141539+0000","last_undegraded":"2024-09-15T22:56:22.141539+0000","last_fullsized":"2024-09-15T22:56:22.141539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:25.498214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003208+0000","last_change":"2024-09-15T22:56:21.060226+0000","last_active":"2024-09-15T22:56:22.003208+0000","last_peered":"2024-09-15T22:56:22.003208+0000","last_clean":"2024-09-15T22:56:22.003208+0000","last_became_active":"2024-09-15T22:56:21.059278+0000","last_became_peered":"2024-09-15T22:56:21.059278+0000","last_unstale":"2024-09-15T22:56:22.003208+0000","last_undegraded":"2024-09-15T22:56:22.003208+0000","last_fullsized":"2024-09-15T22:56:22.003208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005250+0000","last_change":"2024-09-15T22:56:21.031563+0000","last_active":"2024-09-15T22:56:22.005250+0000","last_peered":"2024-09-15T22:56:22.005250+0000","last_clean":"2024-09-15T22:56:22.005250+0000","last_became_active":"2024-09-15T22:56:21.030766+0000","last_became_peered":"2024-09-15T22:56:21.030766+0000","last_unstale":"2024-09-15T22:56:22.005250+0000","last_undegraded":"2024-09-15T22:56:22.005250+0000","last_fullsized":"2024-09-15T22:56:22.005250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006836+0000","last_change":"2024-09-15T22:56:21.027156+0000","last_active":"2024-09-15T22:56:22.006836+0000","last_peered":"2024-09-15T22:56:22.006836+0000","last_clean":"2024-09-15T22:56:22.006836+0000","last_became_active":"2024-09-15T22:56:21.026524+0000","last_became_peered":"2024-09-15T22:56:21.026524+0000","last_unstale":"2024-09-15T22:56:22.006836+0000","last_undegraded":"2024-09-15T22:56:22.006836+0000","last_fullsized":"2024-09-15T22:56:22.006836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179333+0000","last_change":"2024-09-15T22:56:21.026616+0000","last_active":"2024-09-15T22:56:23.179333+0000","last_peered":"2024-09-15T22:56:23.179333+0000","last_clean":"2024-09-15T22:56:23.179333+0000","last_became_active":"2024-09-15T22:56:21.025720+0000","last_became_peered":"2024-09-15T22:56:21.025720+0000","last_unstale":"2024-09-15T22:56:23.179333+0000","last_undegraded":"2024-09-15T22:56:23.179333+0000","last_fullsized":"2024-09-15T22:56:23.179333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180750+0000","last_change":"2024-09-15T22:56:21.050095+0000","last_active":"2024-09-15T22:56:23.180750+0000","last_peered":"2024-09-15T22:56:23.180750+0000","last_clean":"2024-09-15T22:56:23.180750+0000","last_became_active":"2024-09-15T22:56:21.049818+0000","last_became_peered":"2024-09-15T22:56:21.049818+0000","last_unstale":"2024-09-15T22:56:23.180750+0000","last_undegraded":"2024-09-15T22:56:23.180750+0000","last_fullsized":"2024-09-15T22:56:23.180750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:38.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051010+0000","last_change":"2024-09-15T22:56:21.060371+0000","last_active":"2024-09-15T22:56:22.051010+0000","last_peered":"2024-09-15T22:56:22.051010+0000","last_clean":"2024-09-15T22:56:22.051010+0000","last_became_active":"2024-09-15T22:56:21.060056+0000","last_became_peered":"2024-09-15T22:56:21.060056+0000","last_unstale":"2024-09-15T22:56:22.051010+0000","last_undegraded":"2024-09-15T22:56:22.051010+0000","last_fullsized":"2024-09-15T22:56:22.051010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141782+0000","last_change":"2024-09-15T22:56:21.032143+0000","last_active":"2024-09-15T22:56:22.141782+0000","last_peered":"2024-09-15T22:56:22.141782+0000","last_clean":"2024-09-15T22:56:22.141782+0000","last_became_active":"2024-09-15T22:56:21.029384+0000","last_became_peered":"2024-09-15T22:56:21.029384+0000","last_unstale":"2024-09-15T22:56:22.141782+0000","last_undegraded":"2024-09-15T22:56:22.141782+0000","last_fullsized":"2024-09-15T22:56:22.141782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006884+0000","last_change":"2024-09-15T22:56:21.033531+0000","last_active":"2024-09-15T22:56:22.006884+0000","last_peered":"2024-09-15T22:56:22.006884+0000","last_clean":"2024-09-15T22:56:22.006884+0000","last_became_active":"2024-09-15T22:56:21.028976+0000","last_became_peered":"2024-09-15T22:56:21.028976+0000","last_unstale":"2024-09-15T22:56:22.006884+0000","last_undegraded":"2024-09-15T22:56:22.006884+0000","last_fullsized":"2024-09-15T22:56:22.006884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216872+0000","last_change":"2024-09-15T22:56:21.062713+0000","last_active":"2024-09-15T22:56:22.216872+0000","last_peered":"2024-09-15T22:56:22.216872+0000","last_clean":"2024-09-15T22:56:22.216872+0000","last_became_active":"2024-09-15T22:56:21.062258+0000","last_became_peered":"2024-09-15T22:56:21.062258+0000","last_unstale":"2024-09-15T22:56:22.216872+0000","last_undegraded":"2024-09-15T22:56:22.216872+0000","last_fullsized":"2024-09-15T22:56:22.216872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005697+0000","last_change":"2024-09-15T22:56:21.036717+0000","last_active":"2024-09-15T22:56:22.005697+0000","last_peered":"2024-09-15T22:56:22.005697+0000","last_clean":"2024-09-15T22:56:22.005697+0000","last_became_active":"2024-09-15T22:56:21.035818+0000","last_became_peered":"2024-09-15T22:56:21.035818+0000","last_unstale":"2024-09-15T22:56:22.005697+0000","last_undegraded":"2024-09-15T22:56:22.005697+0000","last_fullsized":"2024-09-15T22:56:22.005697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218073+0000","last_change":"2024-09-15T22:56:21.050243+0000","last_active":"2024-09-15T22:56:22.218073+0000","last_peered":"2024-09-15T22:56:22.218073+0000","last_clean":"2024-09-15T22:56:22.218073+0000","last_became_active":"2024-09-15T22:56:21.049811+0000","last_became_peered":"2024-09-15T22:56:21.049811+0000","last_unstale":"2024-09-15T22:56:22.218073+0000","last_undegraded":"2024-09-15T22:56:22.218073+0000","last_fullsized":"2024-09-15T22:56:22.218073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051051+0000","last_change":"2024-09-15T22:56:21.034983+0000","last_active":"2024-09-15T22:56:22.051051+0000","last_peered":"2024-09-15T22:56:22.051051+0000","last_clean":"2024-09-15T22:56:22.051051+0000","last_became_active":"2024-09-15T22:56:21.034274+0000","last_became_peered":"2024-09-15T22:56:21.034274+0000","last_unstale":"2024-09-15T22:56:22.051051+0000","last_undegraded":"2024-09-15T22:56:22.051051+0000","last_fullsized":"2024-09-15T22:56:22.051051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003271+0000","last_change":"2024-09-15T22:56:21.039395+0000","last_active":"2024-09-15T22:56:22.003271+0000","last_peered":"2024-09-15T22:56:22.003271+0000","last_clean":"2024-09-15T22:56:22.003271+0000","last_became_active":"2024-09-15T22:56:21.039113+0000","last_became_peered":"2024-09-15T22:56:21.039113+0000","last_unstale":"2024-09-15T22:56:22.003271+0000","last_undegraded":"2024-09-15T22:56:22.003271+0000","last_fullsized":"2024-09-15T22:56:22.003271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217763+0000","last_change":"2024-09-15T22:56:21.062629+0000","last_active":"2024-09-15T22:56:22.217763+0000","last_peered":"2024-09-15T22:56:22.217763+0000","last_clean":"2024-09-15T22:56:22.217763+0000","last_became_active":"2024-09-15T22:56:21.062301+0000","last_became_peered":"2024-09-15T22:56:21.062301+0000","last_unstale":"2024-09-15T22:56:22.217763+0000","last_undegraded":"2024-09-15T22:56:22.217763+0000","last_fullsized":"2024-09-15T22:56:22.217763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142003+0000","last_change":"2024-09-15T22:56:21.036927+0000","last_active":"2024-09-15T22:56:22.142003+0000","last_peered":"2024-09-15T22:56:22.142003+0000","last_clean":"2024-09-15T22:56:22.142003+0000","last_became_active":"2024-09-15T22:56:21.036612+0000","last_became_peered":"2024-09-15T22:56:21.036612+0000","last_unstale":"2024-09-15T22:56:22.142003+0000","last_undegraded":"2024-09-15T22:56:22.142003+0000","last_fullsized":"2024-09-15T22:56:22.142003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007140+0000","last_change":"2024-09-15T22:56:21.039825+0000","last_active":"2024-09-15T22:56:22.007140+0000","last_peered":"2024-09-15T22:56:22.007140+0000","last_clean":"2024-09-15T22:56:22.007140+0000","last_became_active":"2024-09-15T22:56:21.038388+0000","last_became_peered":"2024-09-15T22:56:21.038388+0000","last_unstale":"2024-09-15T22:56:22.007140+0000","last_undegraded":"2024-09-15T22:56:22.007140+0000","last_fullsized":"2024-09-15T22:56:22.007140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179235+0000","last_change":"2024-09-15T22:56:21.018597+0000","last_active":"2024-09-15T22:56:23.179235+0000","last_peered":"2024-09-15T22:56:23.179235+0000","last_clean":"2024-09-15T22:56:23.179235+0000","last_became_active":"2024-09-15T22:56:21.017870+0000","last_became_peered":"2024-09-15T22:56:21.017870+0000","last_unstale":"2024-09-15T22:56:23.179235+0000","last_undegraded":"2024-09-15T22:56:23.179235+0000","last_fullsized":"2024-09-15T22:56:23.179235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050354+0000","last_change":"2024-09-15T22:56:21.035519+0000","last_active":"2024-09-15T22:56:22.050354+0000","last_peered":"2024-09-15T22:56:22.050354+0000","last_clean":"2024-09-15T22:56:22.050354+0000","last_became_active":"2024-09-15T22:56:21.033628+0000","last_became_peered":"2024-09-15T22:56:21.033628+0000","last_unstale":"2024-09-15T22:56:22.050354+0000","last_undegraded":"2024-09-15T22:56:22.050354+0000","last_fullsized":"2024-09-15T22:56:22.050354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008297+0000","last_change":"2024-09-15T22:56:21.042927+0000","last_active":"2024-09-15T22:56:22.008297+0000","last_peered":"2024-09-15T22:56:22.008297+0000","last_clean":"2024-09-15T22:56:22.008297+0000","last_became_active":"2024-09-15T22:56:21.042371+0000","last_became_peered":"2024-09-15T22:56:21.042371+0000","last_unstale":"2024-09-15T22:56:22.008297+0000","last_undegraded":"2024-09-15T22:56:22.008297+0000","last_fullsized":"2024-09-15T22:56:22.008297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:47.722424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217741+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:22.217741+0000","last_peered":"2024-09-15T22:56:22.217741+0000","last_clean":"2024-09-15T22:56:22.217741+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:22.217741+0000","last_undegraded":"2024-09-15T22:56:22.217741+0000","last_fullsized":"2024-09-15T22:56:22.217741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142010+0000","last_change":"2024-09-15T22:56:21.051815+0000","last_active":"2024-09-15T22:56:22.142010+0000","last_peered":"2024-09-15T22:56:22.142010+0000","last_clean":"2024-09-15T22:56:22.142010+0000","last_became_active":"2024-09-15T22:56:21.051533+0000","last_became_peered":"2024-09-15T22:56:21.051533+0000","last_unstale":"2024-09-15T22:56:22.142010+0000","last_undegraded":"2024-09-15T22:56:22.142010+0000","last_fullsized":"2024-09-15T22:56:22.142010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050312+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:22.050312+0000","last_peered":"2024-09-15T22:56:22.050312+0000","last_clean":"2024-09-15T22:56:22.050312+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:22.050312+0000","last_undegraded":"2024-09-15T22:56:22.050312+0000","last_fullsized":"2024-09-15T22:56:22.050312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217152+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:22.217152+0000","last_peered":"2024-09-15T22:56:22.217152+0000","last_clean":"2024-09-15T22:56:22.217152+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:22.217152+0000","last_undegraded":"2024-09-15T22:56:22.217152+0000","last_fullsized":"2024-09-15T22:56:22.217152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216948+0000","last_change":"2024-09-15T22:56:21.037092+0000","last_active":"2024-09-15T22:56:22.216948+0000","last_peered":"2024-09-15T22:56:22.216948+0000","last_clean":"2024-09-15T22:56:22.216948+0000","last_became_active":"2024-09-15T22:56:21.036262+0000","last_became_peered":"2024-09-15T22:56:21.036262+0000","last_unstale":"2024-09-15T22:56:22.216948+0000","last_undegraded":"2024-09-15T22:56:22.216948+0000","last_fullsized":"2024-09-15T22:56:22.216948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005951+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:22.005951+0000","last_peered":"2024-09-15T22:56:22.005951+0000","last_clean":"2024-09-15T22:56:22.005951+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:22.005951+0000","last_undegraded":"2024-09-15T22:56:22.005951+0000","last_fullsized":"2024-09-15T22:56:22.005951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003006+0000","last_change":"2024-09-15T22:56:21.038747+0000","last_active":"2024-09-15T22:56:22.003006+0000","last_peered":"2024-09-15T22:56:22.003006+0000","last_clean":"2024-09-15T22:56:22.003006+0000","last_became_active":"2024-09-15T22:56:21.038452+0000","last_became_peered":"2024-09-15T22:56:21.038452+0000","last_unstale":"2024-09-15T22:56:22.003006+0000","last_undegraded":"2024-09-15T22:56:22.003006+0000","last_fullsized":"2024-09-15T22:56:22.003006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050686+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:22.050686+0000","last_peered":"2024-09-15T22:56:22.050686+0000","last_clean":"2024-09-15T22:56:22.050686+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:22.050686+0000","last_undegraded":"2024-09-15T22:56:22.050686+0000","last_fullsized":"2024-09-15T22:56:22.050686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005757+0000","last_change":"2024-09-15T22:56:21.025007+0000","last_active":"2024-09-15T22:56:22.005757+0000","last_peered":"2024-09-15T22:56:22.005757+0000","last_clean":"2024-09-15T22:56:22.005757+0000","last_became_active":"2024-09-15T22:56:21.023970+0000","last_became_peered":"2024-09-15T22:56:21.023970+0000","last_unstale":"2024-09-15T22:56:22.005757+0000","last_undegraded":"2024-09-15T22:56:22.005757+0000","last_fullsized":"2024-09-15T22:56:22.005757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005763+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:22.005763+0000","last_peered":"2024-09-15T22:56:22.005763+0000","last_clean":"2024-09-15T22:56:22.005763+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:22.005763+0000","last_undegraded":"2024-09-15T22:56:22.005763+0000","last_fullsized":"2024-09-15T22:56:22.005763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142513+0000","last_change":"2024-09-15T22:56:21.029548+0000","last_active":"2024-09-15T22:56:22.142513+0000","last_peered":"2024-09-15T22:56:22.142513+0000","last_clean":"2024-09-15T22:56:22.142513+0000","last_became_active":"2024-09-15T22:56:21.028802+0000","last_became_peered":"2024-09-15T22:56:21.028802+0000","last_unstale":"2024-09-15T22:56:22.142513+0000","last_undegraded":"2024-09-15T22:56:22.142513+0000","last_fullsized":"2024-09-15T22:56:22.142513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003341+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:22.003341+0000","last_peered":"2024-09-15T22:56:22.003341+0000","last_clean":"2024-09-15T22:56:22.003341+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:22.003341+0000","last_undegraded":"2024-09-15T22:56:22.003341+0000","last_fullsized":"2024-09-15T22:56:22.003341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009002+0000","last_change":"2024-09-15T22:56:21.055834+0000","last_active":"2024-09-15T22:56:22.009002+0000","last_peered":"2024-09-15T22:56:22.009002+0000","last_clean":"2024-09-15T22:56:22.009002+0000","last_became_active":"2024-09-15T22:56:21.049855+0000","last_became_peered":"2024-09-15T22:56:21.049855+0000","last_unstale":"2024-09-15T22:56:22.009002+0000","last_undegraded":"2024-09-15T22:56:22.009002+0000","last_fullsized":"2024-09-15T22:56:22.009002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:11.763410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050975+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:22.050975+0000","last_peered":"2024-09-15T22:56:22.050975+0000","last_clean":"2024-09-15T22:56:22.050975+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:22.050975+0000","last_undegraded":"2024-09-15T22:56:22.050975+0000","last_fullsized":"2024-09-15T22:56:22.050975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180006+0000","last_change":"2024-09-15T22:56:21.046560+0000","last_active":"2024-09-15T22:56:23.180006+0000","last_peered":"2024-09-15T22:56:23.180006+0000","last_clean":"2024-09-15T22:56:23.180006+0000","last_became_active":"2024-09-15T22:56:21.045861+0000","last_became_peered":"2024-09-15T22:56:21.045861+0000","last_unstale":"2024-09-15T22:56:23.180006+0000","last_undegraded":"2024-09-15T22:56:23.180006+0000","last_fullsized":"2024-09-15T22:56:23.180006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142150+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:22.142150+0000","last_peered":"2024-09-15T22:56:22.142150+0000","last_clean":"2024-09-15T22:56:22.142150+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:22.142150+0000","last_undegraded":"2024-09-15T22:56:22.142150+0000","last_fullsized":"2024-09-15T22:56:22.142150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141682+0000","last_change":"2024-09-15T22:56:21.030324+0000","last_active":"2024-09-15T22:56:22.141682+0000","last_peered":"2024-09-15T22:56:22.141682+0000","last_clean":"2024-09-15T22:56:22.141682+0000","last_became_active":"2024-09-15T22:56:21.029364+0000","last_became_peered":"2024-09-15T22:56:21.029364+0000","last_unstale":"2024-09-15T22:56:22.141682+0000","last_undegraded":"2024-09-15T22:56:22.141682+0000","last_fullsized":"2024-09-15T22:56:22.141682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007313+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:22.007313+0000","last_peered":"2024-09-15T22:56:22.007313+0000","last_clean":"2024-09-15T22:56:22.007313+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:22.007313+0000","last_undegraded":"2024-09-15T22:56:22.007313+0000","last_fullsized":"2024-09-15T22:56:22.007313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180348+0000","last_change":"2024-09-15T22:56:21.059175+0000","last_active":"2024-09-15T22:56:23.180348+0000","last_peered":"2024-09-15T22:56:23.180348+0000","last_clean":"2024-09-15T22:56:23.180348+0000","last_became_active":"2024-09-15T22:56:21.058849+0000","last_became_peered":"2024-09-15T22:56:21.058849+0000","last_unstale":"2024-09-15T22:56:23.180348+0000","last_undegraded":"2024-09-15T22:56:23.180348+0000","last_fullsized":"2024-09-15T22:56:23.180348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050178+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:22.050178+0000","last_peered":"2024-09-15T22:56:22.050178+0000","last_clean":"2024-09-15T22:56:22.050178+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:22.050178+0000","last_undegraded":"2024-09-15T22:56:22.050178+0000","last_fullsized":"2024-09-15T22:56:22.050178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050382+0000","last_change":"2024-09-15T22:56:21.034329+0000","last_active":"2024-09-15T22:56:22.050382+0000","last_peered":"2024-09-15T22:56:22.050382+0000","last_clean":"2024-09-15T22:56:22.050382+0000","last_became_active":"2024-09-15T22:56:21.032155+0000","last_became_peered":"2024-09-15T22:56:21.032155+0000","last_unstale":"2024-09-15T22:56:22.050382+0000","last_undegraded":"2024-09-15T22:56:22.050382+0000","last_fullsized":"2024-09-15T22:56:22.050382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179149+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:23.179149+0000","last_peered":"2024-09-15T22:56:23.179149+0000","last_clean":"2024-09-15T22:56:23.179149+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:23.179149+0000","last_undegraded":"2024-09-15T22:56:23.179149+0000","last_fullsized":"2024-09-15T22:56:23.179149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179693+0000","last_change":"2024-09-15T22:56:21.060727+0000","last_active":"2024-09-15T22:56:23.179693+0000","last_peered":"2024-09-15T22:56:23.179693+0000","last_clean":"2024-09-15T22:56:23.179693+0000","last_became_active":"2024-09-15T22:56:21.060316+0000","last_became_peered":"2024-09-15T22:56:21.060316+0000","last_unstale":"2024-09-15T22:56:23.179693+0000","last_undegraded":"2024-09-15T22:56:23.179693+0000","last_fullsized":"2024-09-15T22:56:23.179693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009262+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:22.009262+0000","last_peered":"2024-09-15T22:56:22.009262+0000","last_clean":"2024-09-15T22:56:22.009262+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:22.009262+0000","last_undegraded":"2024-09-15T22:56:22.009262+0000","last_fullsized":"2024-09-15T22:56:22.009262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180646+0000","last_change":"2024-09-15T22:56:21.061277+0000","last_active":"2024-09-15T22:56:23.180646+0000","last_peered":"2024-09-15T22:56:23.180646+0000","last_clean":"2024-09-15T22:56:23.180646+0000","last_became_active":"2024-09-15T22:56:21.061012+0000","last_became_peered":"2024-09-15T22:56:21.061012+0000","last_unstale":"2024-09-15T22:56:23.180646+0000","last_undegraded":"2024-09-15T22:56:23.180646+0000","last_fullsized":"2024-09-15T22:56:23.180646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.747289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179357+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:23.179357+0000","last_peered":"2024-09-15T22:56:23.179357+0000","last_clean":"2024-09-15T22:56:23.179357+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:23.179357+0000","last_undegraded":"2024-09-15T22:56:23.179357+0000","last_fullsized":"2024-09-15T22:56:23.179357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.181081+0000","last_change":"2024-09-15T22:56:21.061243+0000","last_active":"2024-09-15T22:56:23.181081+0000","last_peered":"2024-09-15T22:56:23.181081+0000","last_clean":"2024-09-15T22:56:23.181081+0000","last_became_active":"2024-09-15T22:56:21.060909+0000","last_became_peered":"2024-09-15T22:56:21.060909+0000","last_unstale":"2024-09-15T22:56:23.181081+0000","last_undegraded":"2024-09-15T22:56:23.181081+0000","last_fullsized":"2024-09-15T22:56:23.181081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:42.598011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003379+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:22.003379+0000","last_peered":"2024-09-15T22:56:22.003379+0000","last_clean":"2024-09-15T22:56:22.003379+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:22.003379+0000","last_undegraded":"2024-09-15T22:56:22.003379+0000","last_fullsized":"2024-09-15T22:56:22.003379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005819+0000","last_change":"2024-09-15T22:56:21.037223+0000","last_active":"2024-09-15T22:56:22.005819+0000","last_peered":"2024-09-15T22:56:22.005819+0000","last_clean":"2024-09-15T22:56:22.005819+0000","last_became_active":"2024-09-15T22:56:21.036206+0000","last_became_peered":"2024-09-15T22:56:21.036206+0000","last_unstale":"2024-09-15T22:56:22.005819+0000","last_undegraded":"2024-09-15T22:56:22.005819+0000","last_fullsized":"2024-09-15T22:56:22.005819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179520+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:23.179520+0000","last_peered":"2024-09-15T22:56:23.179520+0000","last_clean":"2024-09-15T22:56:23.179520+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:23.179520+0000","last_undegraded":"2024-09-15T22:56:23.179520+0000","last_fullsized":"2024-09-15T22:56:23.179520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180199+0000","last_change":"2024-09-15T22:56:21.046827+0000","last_active":"2024-09-15T22:56:23.180199+0000","last_peered":"2024-09-15T22:56:23.180199+0000","last_clean":"2024-09-15T22:56:23.180199+0000","last_became_active":"2024-09-15T22:56:21.046257+0000","last_became_peered":"2024-09-15T22:56:21.046257+0000","last_unstale":"2024-09-15T22:56:23.180199+0000","last_undegraded":"2024-09-15T22:56:23.180199+0000","last_fullsized":"2024-09-15T22:56:23.180199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179789+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:23.179789+0000","last_peered":"2024-09-15T22:56:23.179789+0000","last_clean":"2024-09-15T22:56:23.179789+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:23.179789+0000","last_undegraded":"2024-09-15T22:56:23.179789+0000","last_fullsized":"2024-09-15T22:56:23.179789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005089+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:22.005089+0000","last_peered":"2024-09-15T22:56:22.005089+0000","last_clean":"2024-09-15T22:56:22.005089+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:22.005089+0000","last_undegraded":"2024-09-15T22:56:22.005089+0000","last_fullsized":"2024-09-15T22:56:22.005089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217092+0000","last_change":"2024-09-15T22:56:21.037507+0000","last_active":"2024-09-15T22:56:22.217092+0000","last_peered":"2024-09-15T22:56:22.217092+0000","last_clean":"2024-09-15T22:56:22.217092+0000","last_became_active":"2024-09-15T22:56:21.036694+0000","last_became_peered":"2024-09-15T22:56:21.036694+0000","last_unstale":"2024-09-15T22:56:22.217092+0000","last_undegraded":"2024-09-15T22:56:22.217092+0000","last_fullsized":"2024-09-15T22:56:22.217092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179425+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:23.179425+0000","last_peered":"2024-09-15T22:56:23.179425+0000","last_clean":"2024-09-15T22:56:23.179425+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:23.179425+0000","last_undegraded":"2024-09-15T22:56:23.179425+0000","last_fullsized":"2024-09-15T22:56:23.179425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141425+0000","last_change":"2024-09-15T22:56:21.059613+0000","last_active":"2024-09-15T22:56:22.141425+0000","last_peered":"2024-09-15T22:56:22.141425+0000","last_clean":"2024-09-15T22:56:22.141425+0000","last_became_active":"2024-09-15T22:56:21.059232+0000","last_became_peered":"2024-09-15T22:56:21.059232+0000","last_unstale":"2024-09-15T22:56:22.141425+0000","last_undegraded":"2024-09-15T22:56:22.141425+0000","last_fullsized":"2024-09-15T22:56:22.141425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:27.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179315+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:23.179315+0000","last_peered":"2024-09-15T22:56:23.179315+0000","last_clean":"2024-09-15T22:56:23.179315+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:23.179315+0000","last_undegraded":"2024-09-15T22:56:23.179315+0000","last_fullsized":"2024-09-15T22:56:23.179315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003288+0000","last_change":"2024-09-15T22:56:21.025917+0000","last_active":"2024-09-15T22:56:22.003288+0000","last_peered":"2024-09-15T22:56:22.003288+0000","last_clean":"2024-09-15T22:56:22.003288+0000","last_became_active":"2024-09-15T22:56:21.024942+0000","last_became_peered":"2024-09-15T22:56:21.024942+0000","last_unstale":"2024-09-15T22:56:22.003288+0000","last_undegraded":"2024-09-15T22:56:22.003288+0000","last_fullsized":"2024-09-15T22:56:22.003288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007443+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:22.007443+0000","last_peered":"2024-09-15T22:56:22.007443+0000","last_clean":"2024-09-15T22:56:22.007443+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:22.007443+0000","last_undegraded":"2024-09-15T22:56:22.007443+0000","last_fullsized":"2024-09-15T22:56:22.007443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008636+0000","last_change":"2024-09-15T22:56:21.048376+0000","last_active":"2024-09-15T22:56:22.008636+0000","last_peered":"2024-09-15T22:56:22.008636+0000","last_clean":"2024-09-15T22:56:22.008636+0000","last_became_active":"2024-09-15T22:56:21.044757+0000","last_became_peered":"2024-09-15T22:56:21.044757+0000","last_unstale":"2024-09-15T22:56:22.008636+0000","last_undegraded":"2024-09-15T22:56:22.008636+0000","last_fullsized":"2024-09-15T22:56:22.008636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004374+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:22.004374+0000","last_peered":"2024-09-15T22:56:22.004374+0000","last_clean":"2024-09-15T22:56:22.004374+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:22.004374+0000","last_undegraded":"2024-09-15T22:56:22.004374+0000","last_fullsized":"2024-09-15T22:56:22.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006284+0000","last_change":"2024-09-15T22:56:21.037003+0000","last_active":"2024-09-15T22:56:22.006284+0000","last_peered":"2024-09-15T22:56:22.006284+0000","last_clean":"2024-09-15T22:56:22.006284+0000","last_became_active":"2024-09-15T22:56:21.036088+0000","last_became_peered":"2024-09-15T22:56:21.036088+0000","last_unstale":"2024-09-15T22:56:22.006284+0000","last_undegraded":"2024-09-15T22:56:22.006284+0000","last_fullsized":"2024-09-15T22:56:22.006284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180792+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:23.180792+0000","last_peered":"2024-09-15T22:56:23.180792+0000","last_clean":"2024-09-15T22:56:23.180792+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:23.180792+0000","last_undegraded":"2024-09-15T22:56:23.180792+0000","last_fullsized":"2024-09-15T22:56:23.180792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:51.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004381+0000","last_change":"2024-09-15T22:56:21.027999+0000","last_active":"2024-09-15T22:56:22.004381+0000","last_peered":"2024-09-15T22:56:22.004381+0000","last_clean":"2024-09-15T22:56:22.004381+0000","last_became_active":"2024-09-15T22:56:21.027045+0000","last_became_peered":"2024-09-15T22:56:21.027045+0000","last_unstale":"2024-09-15T22:56:22.004381+0000","last_undegraded":"2024-09-15T22:56:22.004381+0000","last_fullsized":"2024-09-15T22:56:22.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004145+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:22.004145+0000","last_peered":"2024-09-15T22:56:22.004145+0000","last_clean":"2024-09-15T22:56:22.004145+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:22.004145+0000","last_undegraded":"2024-09-15T22:56:22.004145+0000","last_fullsized":"2024-09-15T22:56:22.004145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218282+0000","last_change":"2024-09-15T22:56:21.047660+0000","last_active":"2024-09-15T22:56:22.218282+0000","last_peered":"2024-09-15T22:56:22.218282+0000","last_clean":"2024-09-15T22:56:22.218282+0000","last_became_active":"2024-09-15T22:56:21.046792+0000","last_became_peered":"2024-09-15T22:56:21.046792+0000","last_unstale":"2024-09-15T22:56:22.218282+0000","last_undegraded":"2024-09-15T22:56:22.218282+0000","last_fullsized":"2024-09-15T22:56:22.218282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050772+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:22.050772+0000","last_peered":"2024-09-15T22:56:22.050772+0000","last_clean":"2024-09-15T22:56:22.050772+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:22.050772+0000","last_undegraded":"2024-09-15T22:56:22.050772+0000","last_fullsized":"2024-09-15T22:56:22.050772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142574+0000","last_change":"2024-09-15T22:56:21.023902+0000","last_active":"2024-09-15T22:56:22.142574+0000","last_peered":"2024-09-15T22:56:22.142574+0000","last_clean":"2024-09-15T22:56:22.142574+0000","last_became_active":"2024-09-15T22:56:21.022501+0000","last_became_peered":"2024-09-15T22:56:21.022501+0000","last_unstale":"2024-09-15T22:56:22.142574+0000","last_undegraded":"2024-09-15T22:56:22.142574+0000","last_fullsized":"2024-09-15T22:56:22.142574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179422+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:23.179422+0000","last_peered":"2024-09-15T22:56:23.179422+0000","last_clean":"2024-09-15T22:56:23.179422+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:23.179422+0000","last_undegraded":"2024-09-15T22:56:23.179422+0000","last_fullsized":"2024-09-15T22:56:23.179422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008423+0000","last_change":"2024-09-15T22:56:21.057092+0000","last_active":"2024-09-15T22:56:22.008423+0000","last_peered":"2024-09-15T22:56:22.008423+0000","last_clean":"2024-09-15T22:56:22.008423+0000","last_became_active":"2024-09-15T22:56:21.044676+0000","last_became_peered":"2024-09-15T22:56:21.044676+0000","last_unstale":"2024-09-15T22:56:22.008423+0000","last_undegraded":"2024-09-15T22:56:22.008423+0000","last_fullsized":"2024-09-15T22:56:22.008423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003472+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:22.003472+0000","last_peered":"2024-09-15T22:56:22.003472+0000","last_clean":"2024-09-15T22:56:22.003472+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:22.003472+0000","last_undegraded":"2024-09-15T22:56:22.003472+0000","last_fullsized":"2024-09-15T22:56:22.003472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217176+0000","last_change":"2024-09-15T22:56:21.035548+0000","last_active":"2024-09-15T22:56:22.217176+0000","last_peered":"2024-09-15T22:56:22.217176+0000","last_clean":"2024-09-15T22:56:22.217176+0000","last_became_active":"2024-09-15T22:56:21.030034+0000","last_became_peered":"2024-09-15T22:56:21.030034+0000","last_unstale":"2024-09-15T22:56:22.217176+0000","last_undegraded":"2024-09-15T22:56:22.217176+0000","last_fullsized":"2024-09-15T22:56:22.217176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003541+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:22.003541+0000","last_peered":"2024-09-15T22:56:22.003541+0000","last_clean":"2024-09-15T22:56:22.003541+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:22.003541+0000","last_undegraded":"2024-09-15T22:56:22.003541+0000","last_fullsized":"2024-09-15T22:56:22.003541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217560+0000","last_change":"2024-09-15T22:56:21.036761+0000","last_active":"2024-09-15T22:56:22.217560+0000","last_peered":"2024-09-15T22:56:22.217560+0000","last_clean":"2024-09-15T22:56:22.217560+0000","last_became_active":"2024-09-15T22:56:21.036060+0000","last_became_peered":"2024-09-15T22:56:21.036060+0000","last_unstale":"2024-09-15T22:56:22.217560+0000","last_undegraded":"2024-09-15T22:56:22.217560+0000","last_fullsized":"2024-09-15T22:56:22.217560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180453+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:23.180453+0000","last_peered":"2024-09-15T22:56:23.180453+0000","last_clean":"2024-09-15T22:56:23.180453+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:23.180453+0000","last_undegraded":"2024-09-15T22:56:23.180453+0000","last_fullsized":"2024-09-15T22:56:23.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050392+0000","last_change":"2024-09-15T22:56:21.049096+0000","last_active":"2024-09-15T22:56:22.050392+0000","last_peered":"2024-09-15T22:56:22.050392+0000","last_clean":"2024-09-15T22:56:22.050392+0000","last_became_active":"2024-09-15T22:56:21.048786+0000","last_became_peered":"2024-09-15T22:56:21.048786+0000","last_unstale":"2024-09-15T22:56:22.050392+0000","last_undegraded":"2024-09-15T22:56:22.050392+0000","last_fullsized":"2024-09-15T22:56:22.050392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006067+0000","last_change":"2024-09-15T22:56:21.057906+0000","last_active":"2024-09-15T22:56:22.006067+0000","last_peered":"2024-09-15T22:56:22.006067+0000","last_clean":"2024-09-15T22:56:22.006067+0000","last_became_active":"2024-09-15T22:56:21.057525+0000","last_became_peered":"2024-09-15T22:56:21.057525+0000","last_unstale":"2024-09-15T22:56:22.006067+0000","last_undegraded":"2024-09-15T22:56:22.006067+0000","last_fullsized":"2024-09-15T22:56:22.006067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180598+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:23.180598+0000","last_peered":"2024-09-15T22:56:23.180598+0000","last_clean":"2024-09-15T22:56:23.180598+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:23.180598+0000","last_undegraded":"2024-09-15T22:56:23.180598+0000","last_fullsized":"2024-09-15T22:56:23.180598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.753562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005745+0000","last_change":"2024-09-15T22:56:21.058064+0000","last_active":"2024-09-15T22:56:22.005745+0000","last_peered":"2024-09-15T22:56:22.005745+0000","last_clean":"2024-09-15T22:56:22.005745+0000","last_became_active":"2024-09-15T22:56:21.057542+0000","last_became_peered":"2024-09-15T22:56:21.057542+0000","last_unstale":"2024-09-15T22:56:22.005745+0000","last_undegraded":"2024-09-15T22:56:22.005745+0000","last_fullsized":"2024-09-15T22:56:22.005745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180466+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:23.180466+0000","last_peered":"2024-09-15T22:56:23.180466+0000","last_clean":"2024-09-15T22:56:23.180466+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:23.180466+0000","last_undegraded":"2024-09-15T22:56:23.180466+0000","last_fullsized":"2024-09-15T22:56:23.180466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:31.596992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142530+0000","last_change":"2024-09-15T22:56:21.033186+0000","last_active":"2024-09-15T22:56:22.142530+0000","last_peered":"2024-09-15T22:56:22.142530+0000","last_clean":"2024-09-15T22:56:22.142530+0000","last_became_active":"2024-09-15T22:56:21.030711+0000","last_became_peered":"2024-09-15T22:56:21.030711+0000","last_unstale":"2024-09-15T22:56:22.142530+0000","last_undegraded":"2024-09-15T22:56:22.142530+0000","last_fullsized":"2024-09-15T22:56:22.142530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218077+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:22.218077+0000","last_peered":"2024-09-15T22:56:22.218077+0000","last_clean":"2024-09-15T22:56:22.218077+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:22.218077+0000","last_undegraded":"2024-09-15T22:56:22.218077+0000","last_fullsized":"2024-09-15T22:56:22.218077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217920+0000","last_change":"2024-09-15T22:56:21.063433+0000","last_active":"2024-09-15T22:56:22.217920+0000","last_peered":"2024-09-15T22:56:22.217920+0000","last_clean":"2024-09-15T22:56:22.217920+0000","last_became_active":"2024-09-15T22:56:21.062367+0000","last_became_peered":"2024-09-15T22:56:21.062367+0000","last_unstale":"2024-09-15T22:56:22.217920+0000","last_undegraded":"2024-09-15T22:56:22.217920+0000","last_fullsized":"2024-09-15T22:56:22.217920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142732+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:22.142732+0000","last_peered":"2024-09-15T22:56:22.142732+0000","last_clean":"2024-09-15T22:56:22.142732+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:22.142732+0000","last_undegraded":"2024-09-15T22:56:22.142732+0000","last_fullsized":"2024-09-15T22:56:22.142732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:29.907 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:56:29.907 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:56:29.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:56:29.908 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T22:56:29.908 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 Processor -- start 2024-09-15T22:56:30.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 -- start start 2024-09-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7768153380 0x7f77680cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7768160a00 con 0x7f776815d3f0 2024-09-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f776815c910 con 0x7f7768153380 2024-09-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776cf46640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f776815cbf0 con 0x7f7768160400 2024-09-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f776659c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7768153380 0x7f77680cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43246/0 (socket says 172.21.15.28:43246) 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 -- 172.21.15.28:0/2580995777 learned_addr learned my addr 172.21.15.28:0/2580995777 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 -- 172.21.15.28:0/2580995777 >> v2:172.21.15.131:3300/0 conn(0x7f7768153380 msgr2=0x7f77680cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 --2- 172.21.15.28:0/2580995777 >> v2:172.21.15.131:3300/0 conn(0x7f7768153380 0x7f77680cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 -- 172.21.15.28:0/2580995777 >> v1:172.21.15.131:6789/0 conn(0x7f776815d3f0 legacy=0x7f776815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.068+0000 7f7766d9d640 1 -- 172.21.15.28:0/2580995777 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776815ced0 con 0x7f7768160400 2024-09-15T22:56:30.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f7766d9d640 1 --2- 172.21.15.28:0/2580995777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7760009e50 tx=0x7f776001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713b2be102908e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776559a640 1 -- 172.21.15.28:0/2580995777 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77600a5600 con 0x7f7768160400 2024-09-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776559a640 1 -- 172.21.15.28:0/2580995777 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77600a57a0 con 0x7f7768160400 2024-09-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776559a640 1 -- 172.21.15.28:0/2580995777 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77600a5b70 con 0x7f7768160400 2024-09-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 -- 172.21.15.28:0/2580995777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 msgr2=0x7f77680cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 --2- 172.21.15.28:0/2580995777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7760009e50 tx=0x7f776001ca30 comp rx=0 tx=0).stop 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 -- 172.21.15.28:0/2580995777 shutdown_connections 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 --2- 172.21.15.28:0/2580995777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f77680cfd70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 --2- 172.21.15.28:0/2580995777 >> v2:172.21.15.131:3300/0 conn(0x7f7768153380 0x7f77680cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 -- 172.21.15.28:0/2580995777 >> 172.21.15.28:0/2580995777 conn(0x7f77680b0a10 msgr2=0x7f77680b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 -- 172.21.15.28:0/2580995777 shutdown_connections 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.072+0000 7f776cf46640 1 -- 172.21.15.28:0/2580995777 wait complete. 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 Processor -- start 2024-09-15T22:56:30.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- start start 2024-09-15T22:56:30.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 0x7f776814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f776814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f776806fbc0 con 0x7f7768153380 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f776806fa40 con 0x7f776815d3f0 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f776806fd40 con 0x7f7768160400 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34536/0 (socket says 172.21.15.28:34536) 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 -- 172.21.15.28:0/756873288 learned_addr learned my addr 172.21.15.28:0/756873288 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7765d9b640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 0x7f776814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7766d9d640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f776814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 -- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 msgr2=0x7f776814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f776814d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 -- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 msgr2=0x7f776814b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 0x7f776814b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 -- 172.21.15.28:0/756873288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776814cbd0 con 0x7f7768153380 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7765d9b640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 0x7f776814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776659c640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f775800e870 tx=0x7f775800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758017070 con 0x7f7768153380 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775800c940 con 0x7f7768153380 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77680ae300 con 0x7f7768153380 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775800ccf0 con 0x7f7768153380 2024-09-15T22:56:30.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77680ae8c0 con 0x7f7768153380 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.076+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776815fcf0 con 0x7f7768153380 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.080+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f775801a070 con 0x7f7768153380 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.080+0000 7f7756ffd640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 0x7f7748069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.080+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7758085b80 con 0x7f7768153380 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.080+0000 7f7765d9b640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 0x7f7748069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.080+0000 7f7765d9b640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 0x7f7748069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77680730e0 tx=0x7f775c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.084+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77580566c0 con 0x7f7768153380 2024-09-15T22:56:30.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.284+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f77680aecc0 con 0x7f7768153380 2024-09-15T22:56:30.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.292+0000 7f7756ffd640 1 -- 172.21.15.28:0/756873288 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166887 (secure 0 0 0) 0x7f7758055fc0 con 0x7f7768153380 2024-09-15T22:56:30.296 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:30.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 msgr2=0x7f7748069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 0x7f7748069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77680730e0 tx=0x7f775c009040 comp rx=0 tx=0).stop 2024-09-15T22:56:30.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 msgr2=0x7f77680ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f775800e870 tx=0x7f775800ec70 comp rx=0 tx=0).stop 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 shutdown_connections 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7768160400 0x7f776814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f77480678c0 0x7f7748069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f776815d3f0 0x7f776814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 --2- 172.21.15.28:0/756873288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7768153380 0x7f77680ad940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 >> 172.21.15.28:0/756873288 conn(0x7f77680b0a10 msgr2=0x7f77680b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 shutdown_connections 2024-09-15T22:56:30.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.296+0000 7f776cf46640 1 -- 172.21.15.28:0/756873288 wait complete. 2024-09-15T22:56:30.313 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":3892311058},{"type":"v1","addr":"172.21.15.28:6833","nonce":3892311058}]},"active_addr":"172.21.15.28:6833/3892311058","active_change":"2024-09-15T22:56:01.845662+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3564317478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3837461873}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":2131939712}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3220567408}]}]} 2024-09-15T22:56:30.317 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T22:56:30.317 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T22:56:30.317 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:30.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.424+0000 7f235bf24640 1 Processor -- start 2024-09-15T22:56:30.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.424+0000 7f235bf24640 1 -- start start 2024-09-15T22:56:30.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 0x7f2354073f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f235415c660 0x7f23540b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 0x7f23540b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f235415d940 con 0x7f235415c660 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f235415cf90 con 0x7f235415c280 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235bf24640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f235415d270 con 0x7f235415cad0 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f235415c660 0x7f23540b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f235415c660 0x7f23540b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34552/0 (socket says 172.21.15.28:34552) 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 -- 172.21.15.28:0/1019476995 learned_addr learned my addr 172.21.15.28:0/1019476995 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235a4c1640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 0x7f23540b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f2359cc0640 1 --2- 172.21.15.28:0/1019476995 >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 0x7f2354073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 -- 172.21.15.28:0/1019476995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 msgr2=0x7f23540b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 0x7f23540b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 -- 172.21.15.28:0/1019476995 >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 msgr2=0x7f2354073f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 --2- 172.21.15.28:0/1019476995 >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 0x7f2354073f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 -- 172.21.15.28:0/1019476995 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235415d550 con 0x7f235415c660 2024-09-15T22:56:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f235a4c1640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 0x7f23540b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f2359cc0640 1 --2- 172.21.15.28:0/1019476995 >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 0x7f2354073f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.428+0000 7f23594bf640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23540b4380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23540d35e0 tx=0x7f234401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c17ebb65c94b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f2358cbe640 1 -- 172.21.15.28:0/1019476995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b2070 con 0x7f235415c660 2024-09-15T22:56:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f2358cbe640 1 -- 172.21.15.28:0/1019476995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23440a9070 con 0x7f235415c660 2024-09-15T22:56:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f2358cbe640 1 -- 172.21.15.28:0/1019476995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440ad880 con 0x7f235415c660 2024-09-15T22:56:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/1019476995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 msgr2=0x7f23540b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23540b4380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23540d35e0 tx=0x7f234401c490 comp rx=0 tx=0).stop 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/1019476995 shutdown_connections 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415cad0 0x7f23540b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- 172.21.15.28:0/1019476995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23540b4380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- 172.21.15.28:0/1019476995 >> v2:172.21.15.131:3300/0 conn(0x7f235415c280 0x7f2354073f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/1019476995 >> 172.21.15.28:0/1019476995 conn(0x7f2354067a00 msgr2=0x7f2354067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/1019476995 shutdown_connections 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/1019476995 wait complete. 2024-09-15T22:56:30.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 Processor -- start 2024-09-15T22:56:30.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- start start 2024-09-15T22:56:30.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415c280 0x7f235414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 0x7f235415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23540b6740 con 0x7f235415c660 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23540b65c0 con 0x7f235415cad0 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f23540b68c0 con 0x7f235415c280 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34566/0 (socket says 172.21.15.28:34566) 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 -- 172.21.15.28:0/3792861221 learned_addr learned my addr 172.21.15.28:0/3792861221 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f2359cc0640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415c280 0x7f235414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 -- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415c280 msgr2=0x7f235414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415c280 0x7f235414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 -- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 msgr2=0x7f235415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235a4c1640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 0x7f235415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 0x7f235415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 -- 172.21.15.28:0/3792861221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23541f5380 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235a4c1640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 0x7f235415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f23594bf640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23440b0040 tx=0x7f2344019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b2040 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23440bb070 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23540d08e0 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b6860 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.432+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23540d0ea0 con 0x7f235415c660 2024-09-15T22:56:30.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23540d2ec0 con 0x7f235415c660 2024-09-15T22:56:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23440ab070 con 0x7f235415c660 2024-09-15T22:56:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f234a7fc640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 0x7f2338069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f2359cc0640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 0x7f2338069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2344120690 con 0x7f235415c660 2024-09-15T22:56:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.436+0000 7f2359cc0640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 0x7f2338069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f235000c880 tx=0x7f2350008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.440+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2344016110 con 0x7f235415c660 2024-09-15T22:56:30.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.596+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2354073f10 con 0x7f235415c660 2024-09-15T22:56:30.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f234a7fc640 1 -- 172.21.15.28:0/3792861221 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7f23440f11b0 con 0x7f235415c660 2024-09-15T22:56:30.601 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:30.602 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:30.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 msgr2=0x7f2338069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 0x7f2338069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f235000c880 tx=0x7f2350008040 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 msgr2=0x7f23541f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23440b0040 tx=0x7f2344019230 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 shutdown_connections 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f23380678c0 0x7f2338069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f235415cad0 0x7f235415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f235415c660 0x7f23541f4e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 --2- 172.21.15.28:0/3792861221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f235415c280 0x7f235414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 >> 172.21.15.28:0/3792861221 conn(0x7f2354067a00 msgr2=0x7f2354157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 shutdown_connections 2024-09-15T22:56:30.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.600+0000 7f235bf24640 1 -- 172.21.15.28:0/3792861221 wait complete. 2024-09-15T22:56:30.619 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T22:56:30.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:30.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 Processor -- start 2024-09-15T22:56:30.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 -- start start 2024-09-15T22:56:30.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5ff40b3610 0x7f5ff40d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff40d2ba0 con 0x7f5ff406d870 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff40d2e80 con 0x7f5ff415e820 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff94c3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff40d3160 con 0x7f5ff40b3610 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff2ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5ff406d870 0x7f5ff406dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44948/0 (socket says 172.21.15.28:44948) 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff2ffd640 1 -- 172.21.15.28:0/2343447997 learned_addr learned my addr 172.21.15.28:0/2343447997 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff37fe640 1 --2- 172.21.15.28:0/2343447997 >> v2:172.21.15.28:3300/0 conn(0x7f5ff40b3610 0x7f5ff40d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff27fc640 1 -- 172.21.15.28:0/2343447997 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141575427 0 0) 0x7f5ff40d2ba0 con 0x7f5ff406d870 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff27fc640 1 -- 172.21.15.28:0/2343447997 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe0003530 con 0x7f5ff406d870 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff37fe640 1 -- 172.21.15.28:0/2343447997 >> v1:172.21.15.131:6789/0 conn(0x7f5ff415e820 legacy=0x7f5ff40cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff37fe640 1 -- 172.21.15.28:0/2343447997 >> v1:172.21.15.28:6789/0 conn(0x7f5ff406d870 legacy=0x7f5ff406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.728+0000 7f5ff37fe640 1 -- 172.21.15.28:0/2343447997 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40d3440 con 0x7f5ff40b3610 2024-09-15T22:56:30.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff37fe640 1 --2- 172.21.15.28:0/2343447997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40d3c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009d90 tx=0x7f5fec01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84e24d243712697 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff27fc640 1 -- 172.21.15.28:0/2343447997 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0b2070 con 0x7f5ff40b3610 2024-09-15T22:56:30.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff27fc640 1 -- 172.21.15.28:0/2343447997 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec0a5a20 con 0x7f5ff40b3610 2024-09-15T22:56:30.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff27fc640 1 -- 172.21.15.28:0/2343447997 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0a5dd0 con 0x7f5ff40b3610 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/2343447997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 msgr2=0x7f5ff40d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/2343447997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40d3c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009d90 tx=0x7f5fec01c940 comp rx=0 tx=0).stop 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/2343447997 shutdown_connections 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/2343447997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40d3c40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/2343447997 >> 172.21.15.28:0/2343447997 conn(0x7f5ff40d4910 msgr2=0x7f5ff40d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/2343447997 shutdown_connections 2024-09-15T22:56:30.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/2343447997 wait complete. 2024-09-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 Processor -- start 2024-09-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- start start 2024-09-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ff406d870 0x7f5ff4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 0x7f5ff40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff416c540 con 0x7f5ff40b3610 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff416c3c0 con 0x7f5ff415e820 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff416c6c0 con 0x7f5ff406d870 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34584/0 (socket says 172.21.15.28:34584) 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 -- 172.21.15.28:0/3288340802 learned_addr learned my addr 172.21.15.28:0/3288340802 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff37fe640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 0x7f5ff40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 -- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ff406d870 msgr2=0x7f5ff4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff2ffd640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ff406d870 0x7f5ff4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ff406d870 0x7f5ff4156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 -- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 msgr2=0x7f5ff40c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 0x7f5ff40c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 -- 172.21.15.28:0/3288340802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40c9830 con 0x7f5ff40b3610 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff37fe640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 0x7f5ff40c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5febfff640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c3a0 tx=0x7f5fdc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0052d0 con 0x7f5ff40b3610 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc005470 con 0x7f5ff40b3610 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff415aed0 con 0x7f5ff40b3610 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc007260 con 0x7f5ff40b3610 2024-09-15T22:56:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.732+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff40c9db0 con 0x7f5ff40b3610 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff40d3c40 con 0x7f5ff40b3610 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5fdc007400 con 0x7f5ff40b3610 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5feb7fe640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 0x7f5fd4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5fdc0851a0 con 0x7f5ff40b3610 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5ff2ffd640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 0x7f5fd4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.736+0000 7f5ff2ffd640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 0x7f5fd4069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40011f0 tx=0x7f5fe4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.740+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5fdc055c40 con 0x7f5ff40b3610 2024-09-15T22:56:30.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.896+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff4069450 con 0x7f5ff40b3610 2024-09-15T22:56:30.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.900+0000 7f5feb7fe640 1 -- 172.21.15.28:0/3288340802 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7f5fdc055540 con 0x7f5ff40b3610 2024-09-15T22:56:30.902 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:30.902 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 msgr2=0x7f5fd4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 0x7f5fd4069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40011f0 tx=0x7f5fe4009040 comp rx=0 tx=0).stop 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 msgr2=0x7f5ff40b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c3a0 tx=0x7f5fdc00c860 comp rx=0 tx=0).stop 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 shutdown_connections 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5fd40678f0 0x7f5fd4069db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ff415e820 0x7f5ff40c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ff40b3610 0x7f5ff40b5350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 --2- 172.21.15.28:0/3288340802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ff406d870 0x7f5ff4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 >> 172.21.15.28:0/3288340802 conn(0x7f5ff40d4910 msgr2=0x7f5ff40cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 shutdown_connections 2024-09-15T22:56:30.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:30.904+0000 7f5ff94c3640 1 -- 172.21.15.28:0/3288340802 wait complete. 2024-09-15T22:56:30.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T22:56:30.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T22:56:30.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T22:56:30.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T22:56:30.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T22:56:30.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T22:56:30.924 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T22:56:30.924 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T22:56:31.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.100+0000 7f1f42588640 1 Processor -- start 2024-09-15T22:56:31.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.100+0000 7f19fb59e640 1 Processor -- start 2024-09-15T22:56:31.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 -- start start 2024-09-15T22:56:31.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.100+0000 7f1f42588640 1 -- start start 2024-09-15T22:56:31.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.100+0000 7f63dcc42640 1 Processor -- start 2024-09-15T22:56:31.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.100+0000 7f63dcc42640 1 -- start start 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f42588640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1f3c0cf6b0 0x7f1f3c0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f42588640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f42588640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c06ce70 con 0x7f1f3c15af10 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f42588640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1f3c0cc0b0 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f42588640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c06d110 con 0x7f1f3c0cb720 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63dcc42640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f63d80b64d0 0x7f63d8158290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63dcc42640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f63d815acf0 0x7f63d8067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63dcc42640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d815bee0 con 0x7f63d815b160 2024-09-15T22:56:31.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63dcc42640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f63d815c210 con 0x7f63d80b64d0 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63dcc42640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f63d8161680 con 0x7f63d815acf0 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f3bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1f3c15af10 0x7f1f3c071cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44950/0 (socket says 172.21.15.28:44950) 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f3bfff640 1 -- 172.21.15.28:0/551847229 learned_addr learned my addr 172.21.15.28:0/551847229 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f63d815b160 0x7f63d80cfd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44952/0 (socket says 172.21.15.28:44952) 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 -- 172.21.15.28:0/850644165 learned_addr learned my addr 172.21.15.28:0/850644165 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f40b25640 1 --2- 172.21.15.28:0/551847229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 0x7f19f404fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19f40501c0 0x7f19f4037140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f403b570 con 0x7f19f40df7a0 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f19f400b1a0 con 0x7f19f40501c0 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fb59e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f19f4008c10 con 0x7f19f40561f0 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/850644165 >> v2:172.21.15.131:3300/0 conn(0x7f63d815acf0 0x7f63d8067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d659c640 1 --2- 172.21.15.28:0/850644165 >> v2:172.21.15.28:3300/0 conn(0x7f63d80b64d0 0x7f63d8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f3b7fe640 1 --2- 172.21.15.28:0/551847229 >> v2:172.21.15.131:3300/0 conn(0x7f1f3c0cf6b0 0x7f1f3c0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fa59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f19f40df7a0 0x7f19f403ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44960/0 (socket says 172.21.15.28:44960) 2024-09-15T22:56:31.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fa59c640 1 -- 172.21.15.28:0/4199622849 learned_addr learned my addr 172.21.15.28:0/4199622849 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19fad9d640 1 --2- 172.21.15.28:0/4199622849 >> v2:172.21.15.131:3300/0 conn(0x7f19f40501c0 0x7f19f4037140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/4199622849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 0x7f19f404fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150327205 0 0) 0x7f63d815bee0 con 0x7f63d815b160 2024-09-15T22:56:31.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c0003530 con 0x7f63d815b160 2024-09-15T22:56:31.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 758392055 0 0) 0x7f63c0003530 con 0x7f63d815b160 2024-09-15T22:56:31.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 >> v2:172.21.15.131:3300/0 conn(0x7f63d815acf0 msgr2=0x7f63d8067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 --2- 172.21.15.28:0/850644165 >> v2:172.21.15.131:3300/0 conn(0x7f63d815acf0 0x7f63d8067a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 >> v2:172.21.15.28:3300/0 conn(0x7f63d80b64d0 msgr2=0x7f63d8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 --2- 172.21.15.28:0/850644165 >> v2:172.21.15.28:3300/0 conn(0x7f63d80b64d0 0x7f63d8158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 Processor -- start 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 -- start start 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72581008a0 0x7f725800b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72580073f0 con 0x7f7258036030 2024-09-15T22:56:31.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7258007110 con 0x7f72581008a0 2024-09-15T22:56:31.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f7266cc7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7258009c40 con 0x7f7258036c80 2024-09-15T22:56:31.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f72664c6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f72664c6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43312/0 (socket says 172.21.15.28:43312) 2024-09-15T22:56:31.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f72664c6640 1 -- 172.21.15.28:0/1693539721 learned_addr learned my addr 172.21.15.28:0/1693539721 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7fee67fff640 1 Processor -- start 2024-09-15T22:56:31.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19f9d9b640 1 -- 172.21.15.28:0/4199622849 >> v2:172.21.15.131:3300/0 conn(0x7f19f40501c0 msgr2=0x7f19f4037140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/4199622849 >> v2:172.21.15.131:3300/0 conn(0x7f19f40501c0 0x7f19f4037140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19f9d9b640 1 -- 172.21.15.28:0/4199622849 >> v1:172.21.15.28:6789/0 conn(0x7f19f40df7a0 legacy=0x7f19f403ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f19f9d9b640 1 -- 172.21.15.28:0/4199622849 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4008ef0 con 0x7f19f40561f0 2024-09-15T22:56:31.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d815b5e0 con 0x7f63d815b160 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f63d0001a20 con 0x7f63d815b160 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 >> v1:172.21.15.28:6789/0 conn(0x7f63d815b160 legacy=0x7f63d80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c0003a10 0x7f63c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63d815c210 con 0x7f63c00051d0 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8161680 con 0x7f63c0004810 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63c000bf90 con 0x7f63c0003a10 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d659c640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c0003a10 0x7f63c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f40b25640 1 -- 172.21.15.28:0/551847229 >> v2:172.21.15.131:3300/0 conn(0x7f1f3c0cf6b0 msgr2=0x7f1f3c0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f40b25640 1 --2- 172.21.15.28:0/551847229 >> v2:172.21.15.131:3300/0 conn(0x7f1f3c0cf6b0 0x7f1f3c0cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f40b25640 1 -- 172.21.15.28:0/551847229 >> v1:172.21.15.28:6789/0 conn(0x7f1f3c15af10 legacy=0x7f1f3c071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f1f40b25640 1 -- 172.21.15.28:0/551847229 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c06d3f0 con 0x7f1f3c0cb720 2024-09-15T22:56:31.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7fee67fff640 1 -- start start 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 -- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c0003a10 msgr2=0x7f63c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c0003a10 0x7f63c0003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 -- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0004810 msgr2=0x7f63c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0004810 0x7f63c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.104+0000 7f63d6d9d640 1 -- 172.21.15.28:0/850644165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c0003530 con 0x7f63c00051d0 2024-09-15T22:56:31.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/4199622849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 0x7f19f404fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f00207c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333fcb57f57f874e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee67fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fee60057350 0x7fee60038240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee67fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fee60038780 0x7fee600512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee67fff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee60038ba0 con 0x7fee60035b90 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee67fff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fee60050e10 con 0x7fee60038780 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee67fff640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fee6000bec0 con 0x7fee60057350 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee66ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fee60035b90 0x7fee60009110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44972/0 (socket says 172.21.15.28:44972) 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee66ffd640 1 -- 172.21.15.28:0/3854951951 learned_addr learned my addr 172.21.15.28:0/3854951951 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee677fe640 1 --2- 172.21.15.28:0/3854951951 >> v2:172.21.15.28:3300/0 conn(0x7fee60038780 0x7fee600512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee667fc640 1 --2- 172.21.15.28:0/3854951951 >> v2:172.21.15.131:3300/0 conn(0x7fee60057350 0x7fee60038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19f959a640 1 -- 172.21.15.28:0/4199622849 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00b0070 con 0x7f19f40561f0 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19f959a640 1 -- 172.21.15.28:0/4199622849 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f00aa620 con 0x7f19f40561f0 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19f959a640 1 -- 172.21.15.28:0/4199622849 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00aa9f0 con 0x7f19f40561f0 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f40b25640 1 --2- 172.21.15.28:0/551847229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c0cbb70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22e8176edb4676c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f3affd640 1 -- 172.21.15.28:0/551847229 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340b2070 con 0x7f1f3c0cb720 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f3affd640 1 -- 172.21.15.28:0/551847229 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f340a5830 con 0x7f1f3c0cb720 2024-09-15T22:56:31.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f3affd640 1 -- 172.21.15.28:0/551847229 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340a5c00 con 0x7f1f3c0cb720 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 -- 172.21.15.28:0/4199622849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 msgr2=0x7f19f404fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 --2- 172.21.15.28:0/4199622849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 0x7f19f404fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f00207c0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee65ffb640 1 -- 172.21.15.28:0/3854951951 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919687340 0 0) 0x7fee60038ba0 con 0x7fee60035b90 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee65ffb640 1 -- 172.21.15.28:0/3854951951 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee50003530 con 0x7fee60035b90 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee667fc640 1 -- 172.21.15.28:0/3854951951 >> v2:172.21.15.28:3300/0 conn(0x7fee60038780 msgr2=0x7fee600512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee667fc640 1 --2- 172.21.15.28:0/3854951951 >> v2:172.21.15.28:3300/0 conn(0x7fee60038780 0x7fee600512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee667fc640 1 -- 172.21.15.28:0/3854951951 >> v1:172.21.15.28:6789/0 conn(0x7fee60035b90 legacy=0x7fee60009110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7fee667fc640 1 -- 172.21.15.28:0/3854951951 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6000c1a0 con 0x7fee60057350 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f63d6d9d640 1 -- 172.21.15.28:0/850644165 reap_dead start 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63d815c0b0 tx=0x7f63d001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ec767fc1013e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 -- 172.21.15.28:0/4199622849 shutdown_connections 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 --2- 172.21.15.28:0/4199622849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40561f0 0x7f19f404fc80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 --2- 172.21.15.28:0/4199622849 >> v2:172.21.15.131:3300/0 conn(0x7f19f40501c0 0x7f19f4037140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 -- 172.21.15.28:0/4199622849 >> 172.21.15.28:0/4199622849 conn(0x7f19f401ea50 msgr2=0x7f19f40556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f72664c6640 1 -- 172.21.15.28:0/1693539721 >> v2:172.21.15.131:3300/0 conn(0x7f72581008a0 msgr2=0x7f725800b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f72664c6640 1 --2- 172.21.15.28:0/1693539721 >> v2:172.21.15.131:3300/0 conn(0x7f72581008a0 0x7f725800b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f72664c6640 1 -- 172.21.15.28:0/1693539721 >> v1:172.21.15.28:6789/0 conn(0x7f7258036030 legacy=0x7f7258036410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f72664c6640 1 -- 172.21.15.28:0/1693539721 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7258009f20 con 0x7f7258036c80 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 -- 172.21.15.28:0/4199622849 shutdown_connections 2024-09-15T22:56:31.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 -- 172.21.15.28:0/551847229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 msgr2=0x7f1f3c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 --2- 172.21.15.28:0/551847229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c0cbb70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009d90 tx=0x7f1f3401c970 comp rx=0 tx=0).stop 2024-09-15T22:56:31.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000a410 con 0x7f63c00051d0 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 -- 172.21.15.28:0/551847229 shutdown_connections 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 --2- 172.21.15.28:0/551847229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c0cbb70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 --2- 172.21.15.28:0/551847229 >> v2:172.21.15.131:3300/0 conn(0x7f1f3c0cf6b0 0x7f1f3c0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 -- 172.21.15.28:0/551847229 >> 172.21.15.28:0/551847229 conn(0x7f1f3c0cdb50 msgr2=0x7f1f3c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 -- 172.21.15.28:0/551847229 shutdown_connections 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f1f42588640 1 -- 172.21.15.28:0/551847229 wait complete. 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d00ac640 con 0x7f63c00051d0 2024-09-15T22:56:31.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f57c917c640 1 Processor -- start 2024-09-15T22:56:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f57c917c640 1 -- start start 2024-09-15T22:56:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.108+0000 7f19fb59e640 1 -- 172.21.15.28:0/4199622849 wait complete. 2024-09-15T22:56:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 Processor -- start 2024-09-15T22:56:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63d559a640 1 -- 172.21.15.28:0/850644165 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00aca30 con 0x7f63c00051d0 2024-09-15T22:56:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- start start 2024-09-15T22:56:31.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 Processor -- start 2024-09-15T22:56:31.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 -- start start 2024-09-15T22:56:31.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 msgr2=0x7f63c000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63d815c0b0 tx=0x7f63d001d2c0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f72664c6640 1 --2- 172.21.15.28:0/1693539721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f725c007860 tx=0x7f725c01e7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b65c181fd7328d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c917c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57c40cd390 0x7f57c4162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c917c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c406ccd0 con 0x7f57c415ce40 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c917c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c40b5400 con 0x7f57c415ca60 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c917c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f57c40cddb0 con 0x7f57c40cd390 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- 172.21.15.28:0/850644165 shutdown_connections 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 --2- 172.21.15.28:0/850644165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63c00051d0 0x7f63c000b9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- 172.21.15.28:0/850644165 >> 172.21.15.28:0/850644165 conn(0x7f63d8071490 msgr2=0x7f63d80b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7264cc3640 1 -- 172.21.15.28:0/1693539721 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0a7780 con 0x7f7258036c80 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7264cc3640 1 -- 172.21.15.28:0/1693539721 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c00ae50 con 0x7f7258036c80 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7264cc3640 1 -- 172.21.15.28:0/1693539721 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0a7b40 con 0x7f7258036c80 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 -- 172.21.15.28:0/1693539721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 msgr2=0x7f7258054f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 --2- 172.21.15.28:0/1693539721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f725c007860 tx=0x7f725c01e7e0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 -- 172.21.15.28:0/1693539721 shutdown_connections 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 --2- 172.21.15.28:0/1693539721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7258036c80 0x7f7258054f60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 --2- 172.21.15.28:0/1693539721 >> v2:172.21.15.131:3300/0 conn(0x7f72581008a0 0x7f725800b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f7266cc7640 1 -- 172.21.15.28:0/1693539721 >> 172.21.15.28:0/1693539721 conn(0x7f725801d940 msgr2=0x7f72580545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee667fc640 1 --2- 172.21.15.28:0/3854951951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 0x7fee60038240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee6000df80 tx=0x7fee5c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b27d5159b8ff2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee65ffb640 1 -- 172.21.15.28:0/3854951951 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b0070 con 0x7fee60057350 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee65ffb640 1 -- 172.21.15.28:0/3854951951 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c0ab600 con 0x7fee60057350 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee65ffb640 1 -- 172.21.15.28:0/3854951951 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ab9b0 con 0x7fee60057350 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f1f42588640 1 Processor -- start 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f1f42588640 1 -- start start 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f1f42588640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c359e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f57c415ce40 0x7f57c41634c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44982/0 (socket says 172.21.15.28:44982) 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c359e640 1 -- 172.21.15.28:0/485461021 learned_addr learned my addr 172.21.15.28:0/485461021 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c259c640 1 --2- 172.21.15.28:0/485461021 >> v2:172.21.15.131:3300/0 conn(0x7f57c40cd390 0x7f57c4162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c259c640 1 -- 172.21.15.28:0/485461021 >> v1:172.21.15.131:6789/0 conn(0x7f57c415ca60 legacy=0x7f57c40ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c259c640 1 -- 172.21.15.28:0/485461021 >> v1:172.21.15.28:6789/0 conn(0x7f57c415ce40 legacy=0x7f57c41634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f57c259c640 1 -- 172.21.15.28:0/485461021 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c40b56e0 con 0x7f57c40cd390 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 0x7f19f417b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f40561f0 0x7f19f40dc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19f40df7a0 0x7f19f40de930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4006730 con 0x7f19f40df7a0 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f19f40065b0 con 0x7f19f40561f0 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f19f40068b0 con 0x7f19f40501c0 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 0x7f19f417b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 0x7f19f417b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43320/0 (socket says 172.21.15.28:43320) 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 -- 172.21.15.28:0/1394688436 learned_addr learned my addr 172.21.15.28:0/1394688436 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f40561f0 0x7f19f40dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fad9d640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19f40df7a0 0x7f19f40de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 -- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f40561f0 msgr2=0x7f19f40dc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f40561f0 0x7f19f40dc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 -- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19f40df7a0 msgr2=0x7f19f40de930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19f40df7a0 0x7f19f40de930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f40dee70 con 0x7f19f40501c0 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c0e53c0 con 0x7f055c0e4f30 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c0549c0 con 0x7f055c054f80 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0568ff2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f055c038270 con 0x7f055c055360 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43336/0 (socket says 172.21.15.28:43336) 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 -- 172.21.15.28:0/649622565 learned_addr learned my addr 172.21.15.28:0/649622565 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- 172.21.15.28:0/850644165 shutdown_connections 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- 172.21.15.28:0/850644165 wait complete. 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 Processor -- start 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 -- 172.21.15.28:0/649622565 >> v1:172.21.15.131:6789/0 conn(0x7f055c054f80 legacy=0x7f055c0513b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 -- 172.21.15.28:0/649622565 >> v1:172.21.15.28:6789/0 conn(0x7f055c0e4f30 legacy=0x7f055c051ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f0561d9b640 1 -- 172.21.15.28:0/649622565 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c038550 con 0x7f055c055360 2024-09-15T22:56:31.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fa59c640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 0x7f19f417b630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c3f0 tx=0x7f19ec00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 -- 172.21.15.28:0/3854951951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 msgr2=0x7fee60038240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 --2- 172.21.15.28:0/3854951951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 0x7fee60038240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee6000df80 tx=0x7fee5c01c4a0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 -- 172.21.15.28:0/3854951951 shutdown_connections 2024-09-15T22:56:31.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 --2- 172.21.15.28:0/3854951951 >> v2:172.21.15.28:3300/0 conn(0x7fee60038780 0x7fee600512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 --2- 172.21.15.28:0/3854951951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 0x7fee60038240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 -- 172.21.15.28:0/3854951951 >> 172.21.15.28:0/3854951951 conn(0x7fee600567c0 msgr2=0x7fee60056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec017070 con 0x7f19f40501c0 2024-09-15T22:56:31.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 -- 172.21.15.28:0/3854951951 shutdown_connections 2024-09-15T22:56:31.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ec005cf0 con 0x7f19f40501c0 2024-09-15T22:56:31.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f40df110 con 0x7f19f40501c0 2024-09-15T22:56:31.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7fee67fff640 1 -- 172.21.15.28:0/3854951951 wait complete. 2024-09-15T22:56:31.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 Processor -- start 2024-09-15T22:56:31.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- 172.21.15.28:0/1693539721 shutdown_connections 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f63dcc42640 1 -- start start 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 0x7f63d806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d8072b20 0x7f63d80cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d8072fa0 0x7f63d80cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8158290 con 0x7f63d8072fa0 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63d815bba0 con 0x7f63d8072b20 2024-09-15T22:56:31.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63dcc42640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63d8158410 con 0x7f63c00051d0 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec0072d0 con 0x7f19f40501c0 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.112+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f404e4b0 con 0x7f19f40501c0 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d659c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 0x7f63d806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d659c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 0x7f63d806dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43358/0 (socket says 172.21.15.28:43358) 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d659c640 1 -- 172.21.15.28:0/2220648790 learned_addr learned my addr 172.21.15.28:0/2220648790 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d8072b20 0x7f63d80cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d8072fa0 0x7f63d80cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19f404e890 con 0x7f19f40501c0 2024-09-15T22:56:31.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- 172.21.15.28:0/1693539721 wait complete. 2024-09-15T22:56:31.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 Processor -- start 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 -- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 msgr2=0x7f63d806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 -- start start 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd0980b3630 0x7fd098166280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd098166980 con 0x7fd0981626b0 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd0980d3f30 con 0x7fd0980b3630 2024-09-15T22:56:31.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd09c90a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd098167220 con 0x7fd0980ce930 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 0x7f63d806dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 -- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d8072b20 msgr2=0x7f63d80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d8072b20 0x7f63d80cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d815a7e0 con 0x7f63d8072fa0 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d8072b20 0x7f63d80cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d659c640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c00051d0 0x7f63d806dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:31.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 -- start start 2024-09-15T22:56:31.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43360/0 (socket says 172.21.15.28:43360) 2024-09-15T22:56:31.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 -- 172.21.15.28:0/3550033160 learned_addr learned my addr 172.21.15.28:0/3550033160 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c259c640 1 --2- 172.21.15.28:0/485461021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c40cd390 0x7f57c4162f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097c0 tx=0x7f57b801c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a537d5ff54b0c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 Processor -- start 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 0x7fee600e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee60038780 0x7fee6003bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 0x7fee60007d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee60052170 con 0x7fee60035b90 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fee60051ff0 con 0x7fee60057350 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee67fff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fee600522f0 con 0x7fee60038780 2024-09-15T22:56:31.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 0x7f1f3c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f3c15af10 0x7f1f3c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c06e400 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c15b2f0 con 0x7f1f3c15af10 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c06e580 con 0x7f1f3c0cb720 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 0x7f1f3c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd096ffd640 1 --2- 172.21.15.28:0/3550033160 >> v2:172.21.15.131:3300/0 conn(0x7fd0980b3630 0x7fd098166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 0x7f1f3c146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34650/0 (socket says 172.21.15.28:34650) 2024-09-15T22:56:31.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 -- 172.21.15.28:0/2011980547 learned_addr learned my addr 172.21.15.28:0/2011980547 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c1d9b640 1 -- 172.21.15.28:0/485461021 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b80b0070 con 0x7f57c40cd390 2024-09-15T22:56:31.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c1d9b640 1 -- 172.21.15.28:0/485461021 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b80ab600 con 0x7f57c40cd390 2024-09-15T22:56:31.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3bfff640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 0x7fee600e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 0x7fee600e0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34662/0 (socket says 172.21.15.28:34662) 2024-09-15T22:56:31.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 -- 172.21.15.28:0/3586444588 learned_addr learned my addr 172.21.15.28:0/3586444588 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c1d9b640 1 -- 172.21.15.28:0/485461021 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b80ab9d0 con 0x7f57c40cd390 2024-09-15T22:56:31.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 -- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 msgr2=0x7f1f3c14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f40b25640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f3c15af10 0x7f1f3c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1f3c0cb720 0x7f1f3c14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 -- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f3c15af10 msgr2=0x7f1f3c147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f3c15af10 0x7f1f3c147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c14cf60 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f40b25640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f3c15af10 0x7f1f3c147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 -- 172.21.15.28:0/3586444588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee60038780 msgr2=0x7fee6003bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee60038780 0x7fee6003bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 -- 172.21.15.28:0/3586444588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 msgr2=0x7fee60007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee60057350 0x7fee60007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee600e16a0 con 0x7fee60035b90 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f3b7fe640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 0x7f1f3c146d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e870 tx=0x7f1f2c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- start start 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258036030 0x7f72581a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72580f0110 0x7f72580050e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72580f0590 0x7f7258005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f725810d570 con 0x7f7258036030 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f725810d3f0 con 0x7f72580f0590 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7266cc7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f725810d6f0 con 0x7f72580f0110 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c917c640 1 -- 172.21.15.28:0/485461021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c40cd390 msgr2=0x7f57c4162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f57c917c640 1 --2- 172.21.15.28:0/485461021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c40cd390 0x7f57c4162f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097c0 tx=0x7f57b801c340 comp rx=0 tx=0).stop 2024-09-15T22:56:31.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f72664c6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72580f0590 0x7f7258005620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f63d6d9d640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d8072fa0 0x7f63d80cf830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63d8070b20 tx=0x7f63c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fee66ffd640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 0x7fee600e0e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee68050e10 tx=0x7fee68069110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f72654c4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72580f0110 0x7f72580050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f72654c4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72580f0110 0x7f72580050e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43384/0 (socket says 172.21.15.28:43384) 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f72654c4640 1 -- 172.21.15.28:0/2629879637 learned_addr learned my addr 172.21.15.28:0/2629879637 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f7265cc5640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258036030 0x7f72581a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 -- 172.21.15.28:0/3550033160 >> v2:172.21.15.131:3300/0 conn(0x7fd0980b3630 msgr2=0x7fd098166280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00c940 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00ccf0 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c14e950 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c14d500 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 --2- 172.21.15.28:0/3550033160 >> v2:172.21.15.131:3300/0 conn(0x7fd0980b3630 0x7fd098166280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 -- 172.21.15.28:0/3550033160 >> v1:172.21.15.131:6789/0 conn(0x7fd0981626b0 legacy=0x7fd0980b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.116+0000 7fd097fff640 1 -- 172.21.15.28:0/3550033160 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd098166c60 con 0x7fd0980ce930 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 -- 172.21.15.28:0/2629879637 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72580f0110 msgr2=0x7f72580050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72580f0110 0x7f72580050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 -- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258036030 msgr2=0x7f72581a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258036030 0x7f72581a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7258031cf0 con 0x7f72580f0590 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72664c6640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72580f0590 0x7f7258005620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f725c0ad000 tx=0x7f725c01b580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- 172.21.15.28:0/485461021 shutdown_connections 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 --2- 172.21.15.28:0/485461021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c40cd390 0x7f57c4162f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- 172.21.15.28:0/485461021 >> 172.21.15.28:0/485461021 conn(0x7f57c40b1ed0 msgr2=0x7f57c40b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- 172.21.15.28:0/485461021 shutdown_connections 2024-09-15T22:56:31.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19ec01a070 con 0x7f19f40501c0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19dc0678c0 0x7f19dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19ec0857e0 con 0x7f19f40501c0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7f19dc06fae0 0x7f19dc071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19ec013e50 con 0x7f19dc06fae0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f19ec085bd0 con 0x7f19f40501c0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd097fff640 1 --2- 172.21.15.28:0/3550033160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd09806e5b0 tx=0x7fd08c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=527cf1fe47f48a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19dc0678c0 0x7f19dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f3c147780 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19fad9d640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7f19dc06fae0 0x7f19dc071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68093470 con 0x7fee60035b90 2024-09-15T22:56:31.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee68092070 con 0x7fee60035b90 2024-09-15T22:56:31.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68093830 con 0x7fee60035b90 2024-09-15T22:56:31.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- 172.21.15.28:0/485461021 wait complete. 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0af600 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7258031fd0 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7258032590 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0af7a0 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0afb90 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7248001040 con 0x7f72580f0590 2024-09-15T22:56:31.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd0967fc640 1 -- 172.21.15.28:0/3550033160 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0b0070 con 0x7fd0980ce930 2024-09-15T22:56:31.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19f9d9b640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19dc0678c0 0x7f19dc069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19f00b2000 tx=0x7f19f00ab000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd0967fc640 1 -- 172.21.15.28:0/3550033160 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08c0ab600 con 0x7fd0980ce930 2024-09-15T22:56:31.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd0967fc640 1 -- 172.21.15.28:0/3550033160 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0ab9d0 con 0x7fd0980ce930 2024-09-15T22:56:31.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 Processor -- start 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f19fad9d640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7f19dc06fae0 0x7f19dc071f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00019e0 con 0x7f63d8072fa0 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d00ac7f0 con 0x7f63d8072fa0 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00acba0 con 0x7f63d8072fa0 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 -- 172.21.15.28:0/3550033160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 msgr2=0x7fd0980ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 --2- 172.21.15.28:0/3550033160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd09806e5b0 tx=0x7fd08c01c470 comp rx=0 tx=0).stop 2024-09-15T22:56:31.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee600e1980 con 0x7fee60035b90 2024-09-15T22:56:31.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee600e1f40 con 0x7fee60035b90 2024-09-15T22:56:31.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee600512a0 con 0x7fee60035b90 2024-09-15T22:56:31.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- start start 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57c40cd390 0x7f57c415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c415ca60 0x7f57c4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 0x7f57c42037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57c416fd80 con 0x7f57c415ce40 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f57c40b5170 con 0x7f57c415ca60 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c917c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f57c416ff00 con 0x7f57c40cd390 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f63dcc42640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d80cfd70 con 0x7f63d8072fa0 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f63dcc42640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d806ed10 con 0x7f63d8072fa0 2024-09-15T22:56:31.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f2c01a070 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f38ff9640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1f28067990 0x7f1f28069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f2c085b40 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f38ff9640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7f1f2806fb30 0x7f1f28071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f2c00be50 con 0x7f1f2806fb30 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 0x7f57c42037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 0x7f57c42037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34668/0 (socket says 172.21.15.28:34668) 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c359e640 1 -- 172.21.15.28:0/3596227986 learned_addr learned my addr 172.21.15.28:0/3596227986 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c2d9d640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57c40cd390 0x7f57c415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7f57c259c640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c415ca60 0x7f57c4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 -- 172.21.15.28:0/3550033160 shutdown_connections 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 --2- 172.21.15.28:0/3550033160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980ced80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 --2- 172.21.15.28:0/3550033160 >> v2:172.21.15.131:3300/0 conn(0x7fd0980b3630 0x7fd098166280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 -- 172.21.15.28:0/3550033160 >> 172.21.15.28:0/3550033160 conn(0x7fd0980d42e0 msgr2=0x7fd0980d46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.120+0000 7fd09c90a640 1 -- 172.21.15.28:0/3550033160 shutdown_connections 2024-09-15T22:56:31.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 -- 172.21.15.28:0/3550033160 wait complete. 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 -- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57c40cd390 msgr2=0x7f57c415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57c40cd390 0x7f57c415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 -- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c415ca60 msgr2=0x7f57c4154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57c415ca60 0x7f57c4154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 -- 172.21.15.28:0/3596227986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c415ab00 con 0x7f57c415ce40 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f63dcc42640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63d8158ea0 con 0x7f63d8072fa0 2024-09-15T22:56:31.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c359e640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 0x7f57c42037d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c390 tx=0x7f57b400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f725c0c0060 con 0x7f72580f0590 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f72440678c0 0x7f7244069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f725c11f670 con 0x7f72580f0590 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f7265cc5640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f72440678c0 0x7f7244069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f724406fae0 0x7f7244071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f725c0ace50 con 0x7f724406fae0 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f725c11fa60 con 0x7f72580f0590 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72654c4640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f724406fae0 0x7f7244071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72654c4640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f724406fae0 0x7f7244071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f7265cc5640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f72440678c0 0x7f7244069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f726006abd0 tx=0x7f726006e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 Processor -- start 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 -- start start 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 0x7fd0980b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0981626b0 0x7fd0980c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0980d3120 con 0x7fd0981626b0 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd0980d2fa0 con 0x7fd0980b3630 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd09c90a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd0980d32a0 con 0x7fd0980ce930 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 0x7fd0980b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f1f40b25640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7f1f2806fb30 0x7f1f28071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f1f40b25640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7f1f2806fb30 0x7f1f28071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4017070 con 0x7f57c415ce40 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b4005cf0 con 0x7f57c415ce40 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4000ff0 con 0x7f57c415ce40 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c917c640 1 -- 172.21.15.28:0/3596227986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c415ade0 con 0x7f57c415ce40 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c917c640 1 -- 172.21.15.28:0/3596227986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c415b680 con 0x7f57c415ce40 2024-09-15T22:56:31.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== osd.5 v2:172.21.15.131:6808/1626453744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19ec013e50 con 0x7f19dc06fae0 2024-09-15T22:56:31.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 0x7fd0980b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50024/0 (socket says 172.21.15.28:50024) 2024-09-15T22:56:31.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 -- 172.21.15.28:0/1667503037 learned_addr learned my addr 172.21.15.28:0/1667503037 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57b401a070 con 0x7f57c415ce40 2024-09-15T22:56:31.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f0561d9b640 1 --2- 172.21.15.28:0/649622565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05540098a0 tx=0x7f055401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9b08fb846d110f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== osd.0 v2:172.21.15.28:6800/426082887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f725c0ace50 con 0x7f724406fae0 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 -- 172.21.15.28:0/1667503037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 msgr2=0x7fd0980c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0980ce930 0x7fd0980c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 -- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0981626b0 msgr2=0x7fd0980c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0981626b0 0x7fd0980c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0980ce110 con 0x7fd0980b3630 2024-09-15T22:56:31.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57b0067910 0x7f57b0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f056159a640 1 -- 172.21.15.28:0/649622565 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540ab430 con 0x7f055c055360 2024-09-15T22:56:31.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57c2d9d640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57b0067910 0x7f57b0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f57b4084e30 con 0x7f57c415ce40 2024-09-15T22:56:31.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63d00bd060 con 0x7f63d8072fa0 2024-09-15T22:56:31.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7fd0977fe640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 0x7fd0980b6710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b410 tx=0x7fd08800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee680939d0 con 0x7fee60035b90 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fee54067990 0x7fee54069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f1f3bfff640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1f28067990 0x7f1f28069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== osd.3 v2:172.21.15.28:6824/1666455377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f2c00be50 con 0x7f1f2806fb30 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1f2c052290 con 0x7f1f3c0cf6b0 2024-09-15T22:56:31.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f57c2d9d640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57b0067910 0x7f57b0069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57bc001f20 tx=0x7f57bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f056159a640 1 -- 172.21.15.28:0/649622565 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05540b0070 con 0x7f055c055360 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.124+0000 7f056159a640 1 -- 172.21.15.28:0/649622565 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540ab7f0 con 0x7f055c055360 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- 172.21.15.28:0/649622565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 msgr2=0x7f055c054330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 --2- 172.21.15.28:0/649622565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05540098a0 tx=0x7f055401c540 comp rx=0 tx=0).stop 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- 172.21.15.28:0/649622565 shutdown_connections 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 --2- 172.21.15.28:0/649622565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c055360 0x7f055c054330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- 172.21.15.28:0/649622565 >> 172.21.15.28:0/649622565 conn(0x7f055c0567f0 msgr2=0x7f055c056c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63c6ffd640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63b8067990 0x7f63b8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f63d011fab0 con 0x7f63d8072fa0 2024-09-15T22:56:31.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63c6ffd640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f63b806fbb0 0x7f63b8071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d00a6e50 con 0x7f63b806fbb0 2024-09-15T22:56:31.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f63d0122320 con 0x7f63d8072fa0 2024-09-15T22:56:31.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f1f3bfff640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1f28067990 0x7f1f28069e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f30000f70 tx=0x7f1f30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- 172.21.15.28:0/649622565 shutdown_connections 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088015030 con 0x7fd0980b3630 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0981648a0 con 0x7fd0980b3630 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd098164e60 con 0x7fd0980b3630 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088004020 con 0x7fd0980b3630 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee68101ee0 con 0x7fee60035b90 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee667fc640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fee54067990 0x7fee54069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7fee5406fbb0 0x7fee54071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee6806fe50 con 0x7fee5406fbb0 2024-09-15T22:56:31.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fee681022d0 con 0x7fee60035b90 2024-09-15T22:56:31.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088004410 con 0x7fd0980b3630 2024-09-15T22:56:31.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd078001040 con 0x7fd0980b3630 2024-09-15T22:56:31.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee677fe640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7fee5406fbb0 0x7fee54071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee667fc640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fee54067990 0x7fee54069e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ad000 tx=0x7fee5c004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee677fe640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7fee5406fbb0 0x7fee54071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== osd.1 v2:172.21.15.28:6808/3529915784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee6806fe50 con 0x7fee5406fbb0 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- 172.21.15.28:0/649622565 wait complete. 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f57c917c640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7f57c415bba0 0x7f57c414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f57c917c640 1 -- 172.21.15.28:0/3596227986 --> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57c4155ba0 con 0x7f57c415bba0 2024-09-15T22:56:31.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63d659c640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63b8067990 0x7f63b8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f63b806fbb0 0x7f63b8071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 Processor -- start 2024-09-15T22:56:31.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f57c259c640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7f57c415bba0 0x7f57c414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.128+0000 7f0568ff2640 1 -- start start 2024-09-15T22:56:31.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f63d659c640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63b8067990 0x7f63b8069e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63d8073840 tx=0x7f63cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f57c259c640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7f57c415bba0 0x7f57c414db60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f055c054f80 0x7f055c0d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 0x7f055c0dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 0x7f055c0dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 0x7f055c0dfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34674/0 (socket says 172.21.15.28:34674) 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c0e4f30 0x7f055c0e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f056259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f055c054f80 0x7f055c0d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f056259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f055c054f80 0x7f055c0d76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50032/0 (socket says 172.21.15.28:50032) 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 -- 172.21.15.28:0/521305226 learned_addr learned my addr 172.21.15.28:0/521305226 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f055c039030 con 0x7f055c055360 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f055c0eeeb0 con 0x7f055c054f80 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f055c0e30d0 con 0x7f055c0e4f30 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd088018070 con 0x7fd0980b3630 2024-09-15T22:56:31.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0562d9d640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c0e4f30 0x7f055c0e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd084067910 0x7fd084069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 -- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c0e4f30 msgr2=0x7f055c0e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f055c0e4f30 0x7f055c0e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 -- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f055c054f80 msgr2=0x7f055c0d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f055c054f80 0x7f055c0d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c0e33b0 con 0x7f055c055360 2024-09-15T22:56:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd088085f60 con 0x7fd0980b3630 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0561d9b640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 0x7f055c0dfcf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05540098a0 tx=0x7f05540192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540b4630 con 0x7f055c055360 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c0d6eb0 con 0x7f055c055360 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7fd08406fb90 0x7fd084071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd088004020 con 0x7fd08406fb90 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd088086440 con 0x7fd0980b3630 2024-09-15T22:56:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd096ffd640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd084067910 0x7fd084069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd097fff640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7fd08406fb90 0x7fd084071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== osd.4 v2:172.21.15.131:6800/3878671609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57c4155ba0 con 0x7f57c415bba0 2024-09-15T22:56:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd096ffd640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd084067910 0x7fd084069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0900070b0 tx=0x7fd090007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7fd097fff640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7fd08406fb90 0x7fd084071fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.132+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c0e0230 con 0x7f055c055360 2024-09-15T22:56:31.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05540bb070 con 0x7f055c055360 2024-09-15T22:56:31.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== osd.2 v2:172.21.15.28:6816/1391193477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd088004020 con 0x7fd08406fb90 2024-09-15T22:56:31.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540b4a30 con 0x7f055c055360 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0548001040 con 0x7f055c055360 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f05540b4c50 con 0x7f055c055360 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f05440679c0 0x7f0544069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f055411fc50 con 0x7f055c055360 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f056259c640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f05440679c0 0x7f0544069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7f054406fc40 0x7f0544072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f63d5d9b640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f63b806fbb0 0x7f63b8071fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05540aee50 con 0x7f054406fc40 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.136+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0554124200 con 0x7f055c055360 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.140+0000 7f056259c640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f05440679c0 0x7f0544069e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.140+0000 7f0562d9d640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7f054406fc40 0x7f0544072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.140+0000 7f0562d9d640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7f054406fc40 0x7f0544072060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.140+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== osd.7 v2:172.21.15.131:6824/1980628062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63d00a6e50 con 0x7f63b806fbb0 2024-09-15T22:56:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.148+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 --> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19f4037140 con 0x7f19dc06fae0 2024-09-15T22:56:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19eaffd640 1 -- 172.21.15.28:0/1394688436 <== osd.5 v2:172.21.15.131:6808/1626453744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19f4037140 con 0x7f19dc06fae0 2024-09-15T22:56:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7f19dc06fae0 msgr2=0x7f19dc071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7f19dc06fae0 0x7f19dc071f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== osd.6 v2:172.21.15.131:6816/1452359043 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05540aee50 con 0x7f054406fc40 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19dc0678c0 msgr2=0x7f19dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19dc0678c0 0x7f19dc069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19f00b2000 tx=0x7f19f00ab000 comp rx=0 tx=0).stop 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 msgr2=0x7f19f417b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 --2- 172.21.15.28:0/1394688436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19f40501c0 0x7f19f417b630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c3f0 tx=0x7f19ec00c8b0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fad9d640 1 -- 172.21.15.28:0/1394688436 reap_dead start 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 shutdown_connections 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 >> 172.21.15.28:0/1394688436 conn(0x7f19f401ea50 msgr2=0x7f19f4007eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 shutdown_connections 2024-09-15T22:56:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f19fb59e640 1 -- 172.21.15.28:0/1394688436 wait complete. 2024-09-15T22:56:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 --> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7248002de0 con 0x7f724406fae0 2024-09-15T22:56:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.152+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 --> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f3c0cbb70 con 0x7f1f2806fb30 2024-09-15T22:56:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f38ff9640 1 -- 172.21.15.28:0/2011980547 <== osd.3 v2:172.21.15.28:6824/1666455377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f3c0cbb70 con 0x7f1f2806fb30 2024-09-15T22:56:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7f1f2806fb30 msgr2=0x7f1f28071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7f1f2806fb30 0x7f1f28071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1f28067990 msgr2=0x7f1f28069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1f28067990 0x7f1f28069e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f30000f70 tx=0x7f1f30009040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 msgr2=0x7f1f3c146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 --2- 172.21.15.28:0/2011980547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f3c0cf6b0 0x7f1f3c146d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e870 tx=0x7f1f2c00ec70 comp rx=0 tx=0).stop 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f40b25640 1 -- 172.21.15.28:0/2011980547 reap_dead start 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 shutdown_connections 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 >> 172.21.15.28:0/2011980547 conn(0x7f1f3c0cdb50 msgr2=0x7f1f3c06c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 shutdown_connections 2024-09-15T22:56:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7f1f42588640 1 -- 172.21.15.28:0/2011980547 wait complete. 2024-09-15T22:56:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 --> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee60007840 con 0x7fee5406fbb0 2024-09-15T22:56:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee4ffff640 1 -- 172.21.15.28:0/3586444588 <== osd.1 v2:172.21.15.28:6808/3529915784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fee60007840 con 0x7fee5406fbb0 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7fee5406fbb0 msgr2=0x7fee54071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee67fff640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7fee5406fbb0 0x7fee54071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fee54067990 msgr2=0x7fee54069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.156+0000 7fee67fff640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fee54067990 0x7fee54069e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ad000 tx=0x7fee5c004740 comp rx=0 tx=0).stop 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 msgr2=0x7fee600e0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 --2- 172.21.15.28:0/3586444588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee60035b90 0x7fee600e0e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee68050e10 tx=0x7fee68069110 comp rx=0 tx=0).stop 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee677fe640 1 -- 172.21.15.28:0/3586444588 reap_dead start 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 shutdown_connections 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 >> 172.21.15.28:0/3586444588 conn(0x7fee600567c0 msgr2=0x7fee60033950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 shutdown_connections 2024-09-15T22:56:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fee67fff640 1 -- 172.21.15.28:0/3586444588 wait complete. 2024-09-15T22:56:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7f72567fc640 1 -- 172.21.15.28:0/2629879637 <== osd.0 v2:172.21.15.28:6800/426082887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7248002de0 con 0x7f724406fae0 2024-09-15T22:56:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.160+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 --> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd078002de0 con 0x7fd08406fb90 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f724406fae0 msgr2=0x7f7244071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f724406fae0 0x7f7244071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f72440678c0 msgr2=0x7f7244069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f72440678c0 0x7f7244069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f726006abd0 tx=0x7f726006e040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72580f0590 msgr2=0x7f7258005620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 --2- 172.21.15.28:0/2629879637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72580f0590 0x7f7258005620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f725c0ad000 tx=0x7f725c01b580 comp rx=0 tx=0).stop 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f72664c6640 1 -- 172.21.15.28:0/2629879637 reap_dead start 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 shutdown_connections 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 >> 172.21.15.28:0/2629879637 conn(0x7f725801d940 msgr2=0x7f72580fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 shutdown_connections 2024-09-15T22:56:31.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f7266cc7640 1 -- 172.21.15.28:0/2629879637 wait complete. 2024-09-15T22:56:31.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd07ffff640 1 -- 172.21.15.28:0/1667503037 <== osd.2 v2:172.21.15.28:6816/1391193477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd078002de0 con 0x7fd08406fb90 2024-09-15T22:56:31.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7f63dcc42640 1 -- 172.21.15.28:0/2220648790 --> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f63d8067a00 con 0x7f63b806fbb0 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7fd08406fb90 msgr2=0x7fd084071fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7fd08406fb90 0x7fd084071fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd084067910 msgr2=0x7fd084069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd084067910 0x7fd084069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0900070b0 tx=0x7fd090007040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 msgr2=0x7fd0980b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 --2- 172.21.15.28:0/1667503037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0980b3630 0x7fd0980b6710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b410 tx=0x7fd08800b8d0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd097fff640 1 -- 172.21.15.28:0/1667503037 reap_dead start 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 shutdown_connections 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.164+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 >> 172.21.15.28:0/1667503037 conn(0x7fd0980d42e0 msgr2=0x7fd0980b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.168+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 shutdown_connections 2024-09-15T22:56:31.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.168+0000 7fd09c90a640 1 -- 172.21.15.28:0/1667503037 wait complete. 2024-09-15T22:56:31.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.168+0000 7f63c6ffd640 1 -- 172.21.15.28:0/2220648790 <== osd.7 v2:172.21.15.131:6824/1980628062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f63d8067a00 con 0x7f63b806fbb0 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f63b806fbb0 msgr2=0x7f63b8071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f63b806fbb0 0x7f63b8071fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63b8067990 msgr2=0x7f63b8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63b8067990 0x7f63b8069e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63d8073840 tx=0x7f63cc008040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d8072fa0 msgr2=0x7f63d80cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 --2- 172.21.15.28:0/2220648790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d8072fa0 0x7f63d80cf830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63d8070b20 tx=0x7f63c0005840 comp rx=0 tx=0).stop 2024-09-15T22:56:31.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63d6d9d640 1 -- 172.21.15.28:0/2220648790 reap_dead start 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 shutdown_connections 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 >> 172.21.15.28:0/2220648790 conn(0x7f63d8071490 msgr2=0x7f63d814b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 shutdown_connections 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.172+0000 7f63c4ff9640 1 -- 172.21.15.28:0/2220648790 wait complete. 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.180+0000 7f57c917c640 1 -- 172.21.15.28:0/3596227986 --> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57c41558c0 con 0x7f57c415bba0 2024-09-15T22:56:31.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.180+0000 7f57ab7fe640 1 -- 172.21.15.28:0/3596227986 <== osd.4 v2:172.21.15.131:6800/3878671609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57c41558c0 con 0x7f57c415bba0 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7f57c415bba0 msgr2=0x7f57c414db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7f57c415bba0 0x7f57c414db60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57b0067910 msgr2=0x7f57b0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57b0067910 0x7f57b0069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57bc001f20 tx=0x7f57bc009040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 msgr2=0x7f57c42037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 --2- 172.21.15.28:0/3596227986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57c415ce40 0x7f57c42037d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c390 tx=0x7f57b400c850 comp rx=0 tx=0).stop 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57c359e640 1 -- 172.21.15.28:0/3596227986 reap_dead start 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 shutdown_connections 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 >> 172.21.15.28:0/3596227986 conn(0x7f57c40b1ed0 msgr2=0x7f57c4158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 shutdown_connections 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f57a97fa640 1 -- 172.21.15.28:0/3596227986 wait complete. 2024-09-15T22:56:31.202 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:31.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:56:31.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 --> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0548002de0 con 0x7f054406fc40 2024-09-15T22:56:31.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.184+0000 7f0552ffd640 1 -- 172.21.15.28:0/521305226 <== osd.6 v2:172.21.15.131:6816/1452359043 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0548002de0 con 0x7f054406fc40 2024-09-15T22:56:31.204 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:31.204 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7f054406fc40 msgr2=0x7f0544072060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7f054406fc40 0x7f0544072060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f05440679c0 msgr2=0x7f0544069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f05440679c0 0x7f0544069e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558009060 comp rx=0 tx=0).stop 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 msgr2=0x7f055c0dfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 --2- 172.21.15.28:0/521305226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055c055360 0x7f055c0dfcf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05540098a0 tx=0x7f05540192e0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0562d9d640 1 -- 172.21.15.28:0/521305226 reap_dead start 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 shutdown_connections 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 >> 172.21.15.28:0/521305226 conn(0x7f055c0567f0 msgr2=0x7f055c036230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 shutdown_connections 2024-09-15T22:56:31.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.188+0000 7f0568ff2640 1 -- 172.21.15.28:0/521305226 wait complete. 2024-09-15T22:56:31.206 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:31.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:56:31.207 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:31.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:56:31.208 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:31.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:56:31.209 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:31.209 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:56:31.214 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:31.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:56:31.216 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:31.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:56:31.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.364+0000 7f1fbd732640 1 Processor -- start 2024-09-15T22:56:31.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.364+0000 7f1fbd732640 1 -- start start 2024-09-15T22:56:31.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fbd732640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1fb8151480 0x7f1fb80cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fbd732640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fbd732640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb80ce090 con 0x7f1fb80b32b0 2024-09-15T22:56:31.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fbd732640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb80b4040 con 0x7f1fb8151480 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fbd732640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb80ce9c0 con 0x7f1fb80b5540 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1fb80b32b0 0x7f1fb80b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44992/0 (socket says 172.21.15.28:44992) 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1fb8151480 0x7f1fb80cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1fb8151480 0x7f1fb80cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34690/0 (socket says 172.21.15.28:34690) 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb77fe640 1 -- 172.21.15.28:0/3305859188 learned_addr learned my addr 172.21.15.28:0/3305859188 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb67fc640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3305859188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 msgr2=0x7f1fb80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3305859188 >> v1:172.21.15.28:6789/0 conn(0x7f1fb80b32b0 legacy=0x7f1fb80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb5ffb640 1 -- 172.21.15.28:0/3305859188 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79371616 0 0) 0x7f1fb80ce090 con 0x7f1fb80b32b0 2024-09-15T22:56:31.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3305859188 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb80ce370 con 0x7f1fb8151480 2024-09-15T22:56:31.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.368+0000 7f1fb67fc640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:31.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fb6ffd640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb8151480 0x7f1fb80cee50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097c0 tx=0x7f1fac01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46227e7fecb55f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fb5ffb640 1 -- 172.21.15.28:0/3305859188 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0b0070 con 0x7f1fb8151480 2024-09-15T22:56:31.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fb5ffb640 1 -- 172.21.15.28:0/3305859188 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac0ab600 con 0x7f1fb8151480 2024-09-15T22:56:31.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fb5ffb640 1 -- 172.21.15.28:0/3305859188 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0ab9d0 con 0x7f1fb8151480 2024-09-15T22:56:31.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 -- 172.21.15.28:0/3305859188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb8151480 msgr2=0x7f1fb80cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb8151480 0x7f1fb80cee50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097c0 tx=0x7f1fac01c410 comp rx=0 tx=0).stop 2024-09-15T22:56:31.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 -- 172.21.15.28:0/3305859188 shutdown_connections 2024-09-15T22:56:31.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 --2- 172.21.15.28:0/3305859188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb8151480 0x7f1fb80cee50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 -- 172.21.15.28:0/3305859188 >> 172.21.15.28:0/3305859188 conn(0x7f1fb80cca50 msgr2=0x7f1fb80cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 -- 172.21.15.28:0/3305859188 shutdown_connections 2024-09-15T22:56:31.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.372+0000 7f1fbd732640 1 -- 172.21.15.28:0/3305859188 wait complete. 2024-09-15T22:56:31.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 Processor -- start 2024-09-15T22:56:31.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 -- start start 2024-09-15T22:56:31.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 0x7f1fb81507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb806c650 con 0x7f1fb80b32b0 2024-09-15T22:56:31.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb806c4d0 con 0x7f1fb8151480 2024-09-15T22:56:31.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fbd732640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb806c7d0 con 0x7f1fb80b5540 2024-09-15T22:56:31.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34702/0 (socket says 172.21.15.28:34702) 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3893145318 learned_addr learned my addr 172.21.15.28:0/3893145318 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb67fc640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb77fe640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 0x7f1fb81507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 msgr2=0x7f1fb81502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb81502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 msgr2=0x7f1fb81507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 0x7f1fb81507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 -- 172.21.15.28:0/3893145318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb8155ab0 con 0x7f1fb80b32b0 2024-09-15T22:56:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb77fe640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 0x7f1fb81507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.376+0000 7f1fb6ffd640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fac01a040 tx=0x7f1fac01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.380+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0b0050 con 0x7f1fb80b32b0 2024-09-15T22:56:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.380+0000 7f1fbd732640 1 -- 172.21.15.28:0/3893145318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb8155d90 con 0x7f1fb80b32b0 2024-09-15T22:56:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.380+0000 7f1fbd732640 1 -- 172.21.15.28:0/3893145318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb81f7a80 con 0x7f1fb80b32b0 2024-09-15T22:56:31.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac0bc070 con 0x7f1fb80b32b0 2024-09-15T22:56:31.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0b5830 con 0x7f1fb80b32b0 2024-09-15T22:56:31.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fac0b5a90 con 0x7f1fb80b32b0 2024-09-15T22:56:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1f9f7fe640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 0x7f1fa4069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fac120460 con 0x7f1fb80b32b0 2024-09-15T22:56:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1fbd732640 1 -- 172.21.15.28:0/3893145318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f980052a0 con 0x7f1fb80b32b0 2024-09-15T22:56:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1fb67fc640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 0x7f1fa4069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7f1fb67fc640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 0x7f1fa4069e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8156a60 tx=0x7f1fb000c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 Processor -- start 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 -- start start 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd29c08c970 0x7fd29c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd29c0ce980 0x7fd29c0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd29c06bd60 con 0x7fd29c06d300 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd29c0cf2d0 con 0x7fd29c0ce980 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.384+0000 7fd2a2b8b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd29c06f340 con 0x7fd29c08c970 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd29c0ce980 0x7fd29c0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd29c0ce980 0x7fd29c0ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34714/0 (socket says 172.21.15.28:34714) 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 -- 172.21.15.28:0/1261512856 learned_addr learned my addr 172.21.15.28:0/1261512856 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a0927640 1 --2- 172.21.15.28:0/1261512856 >> v2:172.21.15.131:3300/0 conn(0x7fd29c08c970 0x7fd29c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 -- 172.21.15.28:0/1261512856 >> v2:172.21.15.131:3300/0 conn(0x7fd29c08c970 msgr2=0x7fd29c06cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1261512856 >> v2:172.21.15.131:3300/0 conn(0x7fd29c08c970 0x7fd29c06cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 -- 172.21.15.28:0/1261512856 >> v1:172.21.15.131:6789/0 conn(0x7fd29c06d300 legacy=0x7fd29c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fd2a1128640 1 -- 172.21.15.28:0/1261512856 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c06c000 con 0x7fd29c0ce980 2024-09-15T22:56:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 Processor -- start 2024-09-15T22:56:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 -- start start 2024-09-15T22:56:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 Processor -- start 2024-09-15T22:56:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 -- start start 2024-09-15T22:56:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 0x7fc6dc0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc06bd60 con 0x7fc6dc06d220 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc0b4980 con 0x7fc6dc0cf680 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6e0a5e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0b4c60 con 0x7fc6dc15a3b0 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6da59c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc6dc0cf680 0x7fc6dc0b3c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:32998/0 (socket says 172.21.15.28:32998) 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fc6da59c640 1 -- 172.21.15.28:0/341709037 learned_addr learned my addr 172.21.15.28:0/341709037 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa56415e7d0 0x7fa564070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa56406e170 0x7fa56406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56406ff40 con 0x7fa5641589f0 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa5641600f0 con 0x7fa56415e7d0 2024-09-15T22:56:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.388+0000 7fa563fff640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa564161e10 con 0x7fa56406e170 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239804993 0 0) 0x7fc6dc0b4980 con 0x7fc6dc0cf680 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6c4003530 con 0x7fc6dc0cf680 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5627fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa56415e7d0 0x7fa564070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa562ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa5641589f0 0x7fa56415f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45012/0 (socket says 172.21.15.28:45012) 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa562ffd640 1 -- 172.21.15.28:0/270948358 learned_addr learned my addr 172.21.15.28:0/270948358 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5637fe640 1 --2- 172.21.15.28:0/270948358 >> v2:172.21.15.131:3300/0 conn(0x7fa56406e170 0x7fa56406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6dad9d640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 0x7fc6dc0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 Processor -- start 2024-09-15T22:56:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 -- start start 2024-09-15T22:56:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1261512856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c0ced90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd29c069200 tx=0x7fd28c01efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8c3d80f0063af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 Processor -- start 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 -- start start 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5627fc640 1 -- 172.21.15.28:0/270948358 >> v2:172.21.15.131:3300/0 conn(0x7fa56406e170 msgr2=0x7fa56406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5627fc640 1 --2- 172.21.15.28:0/270948358 >> v2:172.21.15.131:3300/0 conn(0x7fa56406e170 0x7fa56406e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5627fc640 1 -- 172.21.15.28:0/270948358 >> v1:172.21.15.28:6789/0 conn(0x7fa5641589f0 legacy=0x7fa56415f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fa5627fc640 1 -- 172.21.15.28:0/270948358 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56415ee00 con 0x7fa56415e7d0 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079962128 0 0) 0x7fc6c4003530 con 0x7fc6dc0cf680 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 msgr2=0x7fc6dc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 0x7fc6dc0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 >> v1:172.21.15.28:6789/0 conn(0x7fc6dc06d220 legacy=0x7fc6dc163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc0b4f40 con 0x7fc6dc0cf680 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fc6d0004cc0 con 0x7fc6dc0cf680 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff540036030 0x7ff540036410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540036bd0 0x7ff540006d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff540054d60 con 0x7ff540039c70 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff540036950 con 0x7ff540036030 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54c8cc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff540009c40 con 0x7ff540036bd0 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54759e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff540039c70 0x7ff54004eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45018/0 (socket says 172.21.15.28:45018) 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54759e640 1 -- 172.21.15.28:0/2609348476 learned_addr learned my addr 172.21.15.28:0/2609348476 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 >> v1:172.21.15.131:6789/0 conn(0x7fc6dc0cf680 legacy=0x7fc6dc0b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40039c0 0x7fc6c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c4004810 0x7fc6c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 0x7fc6c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0b4c60 con 0x7fc6c4004810 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c400ffe0 con 0x7fc6c40039c0 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c400bbd0 con 0x7fc6dc15a3b0 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c4004810 0x7fc6c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 -- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 msgr2=0x7fc6c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6dc15a3b0 0x7fc6c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 -- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40039c0 msgr2=0x7fc6c4003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c40039c0 0x7fc6c4003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7fc6da59c640 1 -- 172.21.15.28:0/341709037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc0b4f40 con 0x7fc6c4004810 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b47f0 0x7ffa1c0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c0b3a30 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c0b3d10 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa23c02640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0b3ff0 con 0x7ffa1c0b47f0 2024-09-15T22:56:31.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff546d9d640 1 --2- 172.21.15.28:0/2609348476 >> v2:172.21.15.131:3300/0 conn(0x7ff540036030 0x7ff540036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fac016090 con 0x7f1fb80b32b0 2024-09-15T22:56:31.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34752/0 (socket says 172.21.15.28:34752) 2024-09-15T22:56:31.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 -- 172.21.15.28:0/2435500810 learned_addr learned my addr 172.21.15.28:0/2435500810 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff54659c640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540036bd0 0x7ff540006d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2119d640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b47f0 0x7ffa1c0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff546d9d640 1 -- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540036bd0 msgr2=0x7ff540006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff546d9d640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540036bd0 0x7ff540006d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff546d9d640 1 -- 172.21.15.28:0/2609348476 >> v1:172.21.15.28:6789/0 conn(0x7ff540039c70 legacy=0x7ff54004eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ff546d9d640 1 -- 172.21.15.28:0/2609348476 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff540009f20 con 0x7ff540036030 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd29b7fe640 1 -- 172.21.15.28:0/1261512856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0ae070 con 0x7fd29c0ce980 2024-09-15T22:56:31.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd29b7fe640 1 -- 172.21.15.28:0/1261512856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c0a8dd0 con 0x7fd29c0ce980 2024-09-15T22:56:31.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd29b7fe640 1 -- 172.21.15.28:0/1261512856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0b2640 con 0x7fd29c0ce980 2024-09-15T22:56:31.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 Processor -- start 2024-09-15T22:56:31.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 -- start start 2024-09-15T22:56:31.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff546d9d640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff540036030 0x7ff540036410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0087a0 tx=0x7ff53c01e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48dd5973d4c34739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff545d9b640 1 -- 172.21.15.28:0/2609348476 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0ad070 con 0x7ff540036030 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 -- 172.21.15.28:0/2435500810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b47f0 msgr2=0x7ffa1c0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b47f0 0x7ffa1c0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 -- 172.21.15.28:0/2435500810 >> v1:172.21.15.131:6789/0 conn(0x7ffa1c06c7e0 legacy=0x7ffa1c1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.392+0000 7ffa2219f640 1 -- 172.21.15.28:0/2435500810 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c0b42d0 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1261512856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 msgr2=0x7fd29c0ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 --2- 172.21.15.28:0/1261512856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c0ced90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd29c069200 tx=0x7fd28c01efc0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82e8054f50 0x7f82e8054300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1261512856 shutdown_connections 2024-09-15T22:56:31.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 --2- 172.21.15.28:0/1261512856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c0ced90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 --2- 172.21.15.28:0/1261512856 >> v2:172.21.15.131:3300/0 conn(0x7fd29c08c970 0x7fd29c06cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1261512856 >> 172.21.15.28:0/1261512856 conn(0x7fd29c0cca50 msgr2=0x7fd29c0cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fa5627fc640 1 --2- 172.21.15.28:0/270948358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa564070240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa56415c3f0 tx=0x7fa55801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce54ddab1230561 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1261512856 shutdown_connections 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1261512856 wait complete. 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ffa2219f640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e50 tx=0x7ffa1401f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27a4d94ed111475 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff545d9b640 1 -- 172.21.15.28:0/2609348476 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c0a78b0 con 0x7ff540036030 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff545d9b640 1 -- 172.21.15.28:0/2609348476 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a7c80 con 0x7ff540036030 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 -- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff540036030 msgr2=0x7ff540036410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff540036030 0x7ff540036410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0087a0 tx=0x7ff53c01e910 comp rx=0 tx=0).stop 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8054990 con 0x7f82e8055330 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8038240 con 0x7f82e80e4f00 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f7ba3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f82e8038520 con 0x7f82e8054f50 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f513e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f82e8055330 0x7f82e8051380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45020/0 (socket says 172.21.15.28:45020) 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f513e640 1 -- 172.21.15.28:0/3419166331 learned_addr learned my addr 172.21.15.28:0/3419166331 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f593f640 1 --2- 172.21.15.28:0/3419166331 >> v2:172.21.15.28:3300/0 conn(0x7f82e8054f50 0x7f82e8054300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f493d640 1 -- 172.21.15.28:0/3419166331 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322140704 0 0) 0x7f82e8038240 con 0x7f82e80e4f00 2024-09-15T22:56:31.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f493d640 1 -- 172.21.15.28:0/3419166331 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82dc003530 con 0x7f82e80e4f00 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 -- 172.21.15.28:0/2609348476 shutdown_connections 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540036bd0 0x7ff540006d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/2609348476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff540036030 0x7ff540036410 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0087a0 tx=0x7ff53c01e910 comp rx=0 tx=0).stop 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7ff54c8cc640 1 -- 172.21.15.28:0/2609348476 >> 172.21.15.28:0/2609348476 conn(0x7ff54001d940 msgr2=0x7ff5400545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f593f640 1 -- 172.21.15.28:0/3419166331 >> v1:172.21.15.131:6789/0 conn(0x7f82e80e4f00 legacy=0x7f82e8051a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f593f640 1 -- 172.21.15.28:0/3419166331 >> v1:172.21.15.28:6789/0 conn(0x7f82e8055330 legacy=0x7f82e8051380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7f82f593f640 1 -- 172.21.15.28:0/3419166331 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8038800 con 0x7f82e8054f50 2024-09-15T22:56:31.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6da59c640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c4004810 0x7fc6c4004c90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d2a0 tx=0x7fc6d001f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf17f3cf1eb5df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fd2a2b8b640 1 Processor -- start 2024-09-15T22:56:31.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7ff54c8cc640 1 -- 172.21.15.28:0/2609348476 shutdown_connections 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fa561ffb640 1 -- 172.21.15.28:0/270948358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580b0070 con 0x7fa56415e7d0 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fa561ffb640 1 -- 172.21.15.28:0/270948358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5580ab600 con 0x7fa56415e7d0 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.396+0000 7fa561ffb640 1 -- 172.21.15.28:0/270948358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580ab9d0 con 0x7fa56415e7d0 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- 172.21.15.28:0/270948358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 msgr2=0x7fa564070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 --2- 172.21.15.28:0/270948358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa564070240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa56415c3f0 tx=0x7fa55801c480 comp rx=0 tx=0).stop 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- 172.21.15.28:0/270948358 shutdown_connections 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 --2- 172.21.15.28:0/270948358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa564070240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 --2- 172.21.15.28:0/270948358 >> v2:172.21.15.131:3300/0 conn(0x7fa56406e170 0x7fa56406e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- 172.21.15.28:0/270948358 >> 172.21.15.28:0/270948358 conn(0x7fa56406f120 msgr2=0x7fa56406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0007050 con 0x7fc6c4004810 2024-09-15T22:56:31.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d00aa710 con 0x7fc6c4004810 2024-09-15T22:56:31.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6d9d9b640 1 -- 172.21.15.28:0/341709037 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0001af0 con 0x7fc6c4004810 2024-09-15T22:56:31.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- 172.21.15.28:0/270948358 shutdown_connections 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f593f640 1 --2- 172.21.15.28:0/3419166331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8054300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f82f006abd0 tx=0x7f82f0098730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70113297b1dde17d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f493d640 1 -- 172.21.15.28:0/3419166331 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0127640 con 0x7f82e8054f50 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f493d640 1 -- 172.21.15.28:0/3419166331 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f01277e0 con 0x7f82e8054f50 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f493d640 1 -- 172.21.15.28:0/3419166331 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0127bd0 con 0x7f82e8054f50 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fd2a2b8b640 1 -- start start 2024-09-15T22:56:31.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fd2a2b8b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 0x7fd29c164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/341709037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c4004810 msgr2=0x7fc6c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/341709037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c4004810 0x7fc6c4004c90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d2a0 tx=0x7fc6d001f9d0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6db59e640 1 -- 172.21.15.28:0/341709037 reap_dead start 2024-09-15T22:56:31.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f7ba3640 1 -- 172.21.15.28:0/3419166331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 msgr2=0x7f82e8054300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/3419166331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8054300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f82f006abd0 tx=0x7f82f0098730 comp rx=0 tx=0).stop 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/341709037 shutdown_connections 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/341709037 >> 172.21.15.28:0/341709037 conn(0x7fc6dc0cff90 msgr2=0x7fc6dc0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/341709037 shutdown_connections 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- 172.21.15.28:0/270948358 wait complete. 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 Processor -- start 2024-09-15T22:56:31.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7ff54c8cc640 1 -- 172.21.15.28:0/2609348476 wait complete. 2024-09-15T22:56:31.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7ff54c8cc640 1 Processor -- start 2024-09-15T22:56:31.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/341709037 wait complete. 2024-09-15T22:56:31.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fc6e0a5e640 1 Processor -- start 2024-09-15T22:56:31.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f7ba3640 1 -- 172.21.15.28:0/3419166331 shutdown_connections 2024-09-15T22:56:31.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/3419166331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8054300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7f82f7ba3640 1 -- 172.21.15.28:0/3419166331 >> 172.21.15.28:0/3419166331 conn(0x7f82e80567c0 msgr2=0x7f82e8056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- 172.21.15.28:0/3419166331 shutdown_connections 2024-09-15T22:56:31.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- start start 2024-09-15T22:56:31.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a2b8b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 0x7fd29c165d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- 172.21.15.28:0/3419166331 wait complete. 2024-09-15T22:56:31.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a2b8b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c16cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 -- start start 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a0927640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 0x7fd29c164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a0927640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 0x7fd29c164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43456/0 (socket says 172.21.15.28:43456) 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd29bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 0x7fd29c165d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd29bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 0x7fd29c165d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50082/0 (socket says 172.21.15.28:50082) 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a0927640 1 -- 172.21.15.28:0/1982950483 learned_addr learned my addr 172.21.15.28:0/1982950483 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c06c8a0 con 0x7fd29c0ce980 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c06c5c0 con 0x7fd29c08c970 2024-09-15T22:56:31.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.400+0000 7fa563fff640 1 -- start start 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 0x7fa5641571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa5640afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540039c70 0x7ff5400f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 0x7ff5400f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff54004f280 con 0x7ff540036bd0 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff54003a490 con 0x7ff5400ffac0 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54c8cc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff54004f400 con 0x7ff540039c70 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34780/0 (socket says 172.21.15.28:34780) 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 -- 172.21.15.28:0/631278491 learned_addr learned my addr 172.21.15.28:0/631278491 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c4004810 0x7fc6dc1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 0x7fc6dc0af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 0x7fc6dc0aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0d0ab0 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc0cfac0 con 0x7fc6dc148170 2024-09-15T22:56:31.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0d0c30 con 0x7fc6c4004810 2024-09-15T22:56:31.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c16cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50088/0 (socket says 172.21.15.28:50088) 2024-09-15T22:56:31.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54659c640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540039c70 0x7ff5400f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c08cd50 con 0x7fd29c06d300 2024-09-15T22:56:31.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6da59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 0x7fc6dc0af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6dad9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c4004810 0x7fc6dc1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6da59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 0x7fc6dc0af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50096/0 (socket says 172.21.15.28:50096) 2024-09-15T22:56:31.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6da59c640 1 -- 172.21.15.28:0/2670898887 learned_addr learned my addr 172.21.15.28:0/2670898887 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 Processor -- start 2024-09-15T22:56:31.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- start start 2024-09-15T22:56:31.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 0x7fc6dc0aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54759e640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 0x7ff5400f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 -- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540039c70 msgr2=0x7ff5400f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540039c70 0x7ff5400f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa5627fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 0x7fa5641571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa5627fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 0x7fa5641571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43472/0 (socket says 172.21.15.28:43472) 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 -- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 msgr2=0x7ff5400f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 0x7ff5400f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 -- 172.21.15.28:0/631278491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff540036620 con 0x7ff540036bd0 2024-09-15T22:56:31.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff54759e640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 0x7ff5400f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 -- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c4004810 msgr2=0x7fc6dc1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c4004810 0x7fc6dc1456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 -- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 msgr2=0x7fc6dc0af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 0x7fc6dc0af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 -- 172.21.15.28:0/2670898887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc0ab490 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa2099c640 1 -- 172.21.15.28:0/2435500810 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa140b4070 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa2099c640 1 -- 172.21.15.28:0/2435500810 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa140af400 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa2099c640 1 -- 172.21.15.28:0/2435500810 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa140af810 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 -- 172.21.15.28:0/3268332718 learned_addr learned my addr 172.21.15.28:0/3268332718 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa564162c80 con 0x7fa56415e7d0 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa564162b00 con 0x7fa56406e170 2024-09-15T22:56:31.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa56416b1b0 con 0x7fa5641589f0 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82e8055330 0x7f82e804e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82e80e4f00 0x7f82e80e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8039000 con 0x7f82e8054f50 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f82e80eee80 con 0x7f82e8055330 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f7ba3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f82e804e3c0 con 0x7f82e80e4f00 2024-09-15T22:56:31.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6db59e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 0x7fc6dc0aa6e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bda0 tx=0x7fc6d400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34806/0 (socket says 172.21.15.28:34806) 2024-09-15T22:56:31.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 -- 172.21.15.28:0/2344837827 learned_addr learned my addr 172.21.15.28:0/2344837827 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ff546d9d640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff53c01cfc0 tx=0x7ff53c01b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f513e640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82e8055330 0x7f82e804e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4017070 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 -- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 msgr2=0x7fd29c164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 0x7fd29c164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 -- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 msgr2=0x7fd29c165d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 0x7fd29c165d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c0aac70 con 0x7fd29c0ce980 2024-09-15T22:56:31.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2a1128640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c16cd90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b0000 tx=0x7fd28c01bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 -- 172.21.15.28:0/2435500810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c0b4c30 msgr2=0x7ffa1c0cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e50 tx=0x7ffa1401f230 comp rx=0 tx=0).stop 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 -- 172.21.15.28:0/2435500810 shutdown_connections 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c0b4c30 0x7ffa1c0cdad0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 --2- 172.21.15.28:0/2435500810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b47f0 0x7ffa1c0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 -- 172.21.15.28:0/2435500810 >> 172.21.15.28:0/2435500810 conn(0x7ffa1c06bcc0 msgr2=0x7ffa1c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 -- 172.21.15.28:0/2435500810 shutdown_connections 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa5637fe640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa5640afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 -- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 msgr2=0x7fa5641571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 0x7fa5641571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 -- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 msgr2=0x7fa5640afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa5640afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5640aae40 con 0x7fa56406e170 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa562ffd640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c530 tx=0x7fa55400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f6140640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82e80e4f00 0x7f82e80e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 -- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82e80e4f00 msgr2=0x7f82e80e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82e80e4f00 0x7f82e80e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 -- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82e8055330 msgr2=0x7f82e804e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82e8055330 0x7f82e804e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7f82f593f640 1 -- 172.21.15.28:0/2344837827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8009140 con 0x7f82e8054f50 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0ad040 con 0x7ff540036bd0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c008bf0 con 0x7ff540036bd0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0059a0 con 0x7ff540036bd0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5400f7860 con 0x7ff540036bd0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5400f7e20 con 0x7ff540036bd0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4007070 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc0ab770 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc0abd30 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc0cf140 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007460 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0ae040 con 0x7fd29c0ce980 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c0c1070 con 0x7fd29c0ce980 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003a50 con 0x7fd29c0ce980 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c0aaf50 con 0x7fd29c0ce980 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fd2a2b8b640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c0ab510 con 0x7fd29c0ce980 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7ffa23c02640 1 -- 172.21.15.28:0/2435500810 wait complete. 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 Processor -- start 2024-09-15T22:56:31.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 -- start start 2024-09-15T22:56:31.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.404+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554017070 con 0x7fa56406e170 2024-09-15T22:56:31.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554005cf0 con 0x7fa56406e170 2024-09-15T22:56:31.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554007270 con 0x7fa56406e170 2024-09-15T22:56:31.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5640ab0c0 con 0x7fa56406e170 2024-09-15T22:56:31.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5640ab680 con 0x7fa56406e170 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82f593f640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82f00693f0 tx=0x7f82f006bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0136070 con 0x7f82e8054f50 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0132640 con 0x7f82e8054f50 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f01329f0 con 0x7f82e8054f50 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e80093e0 con 0x7f82e8054f50 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e804dd70 con 0x7f82e8054f50 2024-09-15T22:56:31.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2740052a0 con 0x7fd29c0ce980 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 0x7ffa1c0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 0x7ffa1c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 0x7ffa1c13e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0cf8c0 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0cf740 con 0x7ffa1c0b47f0 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa23c02640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0cfa40 con 0x7ffa1c0b4c30 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa2119d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 0x7ffa1c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa2119d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 0x7ffa1c14de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50118/0 (socket says 172.21.15.28:50118) 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa2119d640 1 -- 172.21.15.28:0/2562519162 learned_addr learned my addr 172.21.15.28:0/2562519162 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa2199e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 0x7ffa1c0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff540036410 con 0x7ff540036bd0 2024-09-15T22:56:31.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7ffa2219f640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 0x7ffa1c13e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6d4007640 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6c37fe640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 0x7fc6c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc6d4085290 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fc6dad9d640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 0x7fc6c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fc6dad9d640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 0x7fc6c8069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009b10 tx=0x7fc6cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 -- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 msgr2=0x7ffa1c13e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 0x7ffa1c13e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 -- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 msgr2=0x7ffa1c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 0x7ffa1c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 -- 172.21.15.28:0/2562519162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c149fd0 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2219f640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 0x7ffa1c13e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7ffa2199e640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 0x7ffa1c0cd7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000f70 tx=0x7ffa1800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd28c003bf0 con 0x7fd29c0ce980 2024-09-15T22:56:31.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa564070240 con 0x7fa56406e170 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.408+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa55401a070 con 0x7fa56406e170 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fa54b7fe640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 0x7fa54c069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa554084f40 con 0x7fa56406e170 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fa5627fc640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 0x7fa54c069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80052a0 con 0x7f82e8054f50 2024-09-15T22:56:31.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fd2997fa640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 0x7fd288069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fd2a0927640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 0x7fd288069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fa5627fc640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 0x7fa54c069ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ad000 tx=0x7fa5580a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.412+0000 7fd2a0927640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 0x7fd288069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd290013fd0 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6d4020070 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18017070 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ffa23c02640 1 -- 172.21.15.28:0/2562519162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c148f30 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd28c0f2e80 con 0x7fd29c0ce980 2024-09-15T22:56:31.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ffa23c02640 1 -- 172.21.15.28:0/2562519162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c1494f0 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff53c005b60 con 0x7ff540036bd0 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff52f7fe640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff53c11f990 con 0x7ff540036bd0 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa180052d0 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18021060 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff54659c640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c0cfe80 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.416+0000 7ff54659c640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 0x7ff534069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff548063860 tx=0x7ff54806bad0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.420+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82f0139070 con 0x7f82e8054f50 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.420+0000 7f82e67fc640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 0x7f82d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.420+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82f019c5a0 con 0x7f82e8054f50 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.420+0000 7f82f513e640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 0x7f82d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.420+0000 7f82f513e640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 0x7f82d4069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82e804ae30 tx=0x7f82e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.424+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5640aae40 con 0x7fa56406e170 2024-09-15T22:56:31.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.424+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd28c018b20 con 0x7fd29c0ce980 2024-09-15T22:56:31.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 Processor -- start 2024-09-15T22:56:31.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 -- start start 2024-09-15T22:56:31.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff53c0185c0 con 0x7ff540036bd0 2024-09-15T22:56:31.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 0x7f743406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 0x7f743406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7432ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f74340cdb90 0x7f743406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45022/0 (socket says 172.21.15.28:45022) 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74340703e0 con 0x7f74340cdb90 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f74340b5da0 con 0x7f74340cdfd0 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.432+0000 7f7439ff3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f74340b42b0 con 0x7f743415e900 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f7433fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 0x7f743406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f7433fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 0x7f743406e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34822/0 (socket says 172.21.15.28:34822) 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f7433fff640 1 -- 172.21.15.28:0/2068046887 learned_addr learned my addr 172.21.15.28:0/2068046887 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f74337fe640 1 --2- 172.21.15.28:0/2068046887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 0x7f743406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f74337fe640 1 -- 172.21.15.28:0/2068046887 >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 msgr2=0x7f743406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f74337fe640 1 --2- 172.21.15.28:0/2068046887 >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 0x7f743406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f74337fe640 1 -- 172.21.15.28:0/2068046887 >> v1:172.21.15.28:6789/0 conn(0x7f74340cdb90 legacy=0x7f743406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.436+0000 7f74337fe640 1 -- 172.21.15.28:0/2068046887 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74340b4590 con 0x7f743415e900 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f74337fe640 1 --2- 172.21.15.28:0/2068046887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 0x7f743406f6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74240097c0 tx=0x7f742401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412bb68bb50d7045 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f74327fc640 1 -- 172.21.15.28:0/2068046887 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240b0070 con 0x7f743415e900 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f74327fc640 1 -- 172.21.15.28:0/2068046887 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74240ab600 con 0x7f743415e900 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- 172.21.15.28:0/2068046887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 msgr2=0x7f743406f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f74327fc640 1 -- 172.21.15.28:0/2068046887 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240b0070 con 0x7f743415e900 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 --2- 172.21.15.28:0/2068046887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 0x7f743406f6e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74240097c0 tx=0x7f742401c410 comp rx=0 tx=0).stop 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- 172.21.15.28:0/2068046887 shutdown_connections 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 --2- 172.21.15.28:0/2068046887 >> v2:172.21.15.28:3300/0 conn(0x7f74340cdfd0 0x7f743406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 --2- 172.21.15.28:0/2068046887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f743415e900 0x7f743406f6e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- 172.21.15.28:0/2068046887 >> 172.21.15.28:0/2068046887 conn(0x7f74340b2e10 msgr2=0x7f74340b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- 172.21.15.28:0/2068046887 shutdown_connections 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- 172.21.15.28:0/2068046887 wait complete. 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 Processor -- start 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.440+0000 7f7439ff3640 1 -- start start 2024-09-15T22:56:31.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 0x7f743414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f743415e900 0x7f74341566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74340cf200 con 0x7f743415e900 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f74340cf080 con 0x7f74340cdfd0 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7439ff3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7434168620 con 0x7f74340cdb90 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7432ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7432ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:50122/0 (socket says 172.21.15.28:50122) 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7432ffd640 1 -- 172.21.15.28:0/2360631082 learned_addr learned my addr 172.21.15.28:0/2360631082 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 0x7f743414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f82f00924d0 con 0x7f82e8054f50 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7433fff640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f743415e900 0x7f74341566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 -- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 msgr2=0x7f743414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 -- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f743415e900 msgr2=0x7f74341566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f743415e900 0x7f74341566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 -- 172.21.15.28:0/2360631082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743414d4a0 con 0x7f74340cdb90 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f7432ffd640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:31.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.444+0000 7f74337fe640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 0x7f743414c200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74240ab000 tx=0x7f74240191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa1801a070 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7ffa127fc640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 0x7ffa08069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa18085780 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240ba070 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f7439ff3640 1 -- 172.21.15.28:0/2360631082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743414d780 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f7439ff3640 1 -- 172.21.15.28:0/2360631082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f743414dd40 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74240ab9b0 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240b0040 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74240bd070 con 0x7f74340cdb90 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.448+0000 7f741bfff640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 0x7f7420069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.452+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f742411ee30 con 0x7f74340cdb90 2024-09-15T22:56:31.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.452+0000 7ffa2119d640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 0x7ffa08069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.452+0000 7f7432ffd640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 0x7f7420069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.452+0000 7f7432ffd640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 0x7f7420069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74340cd330 tx=0x7f7428007f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.452+0000 7ffa2119d640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 0x7ffa08069ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c15dbb0 tx=0x7ffa0c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.456+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74140052a0 con 0x7f74340cdb90 2024-09-15T22:56:31.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.456+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa18005480 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.468+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7424016090 con 0x7f74340cdb90 2024-09-15T22:56:31.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.716+0000 7f1fbd732640 1 -- 172.21.15.28:0/3893145318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1f98005590 con 0x7f1fb80b32b0 2024-09-15T22:56:31.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.716+0000 7f1f9f7fe640 1 -- 172.21.15.28:0/3893145318 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fac0f1010 con 0x7f1fb80b32b0 2024-09-15T22:56:31.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.716+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc6dc0717d0 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.720 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2024-09-15T22:56:31.721 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2024-09-15T22:56:31.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7fc6c37fe640 1 -- 172.21.15.28:0/2670898887 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6d4055760 con 0x7fc6dc0afaa0 2024-09-15T22:56:31.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 msgr2=0x7f1fa4069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 0x7f1fa4069e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8156a60 tx=0x7f1fb000c040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 msgr2=0x7f1fb8155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fac01a040 tx=0x7f1fac01ac50 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 shutdown_connections 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1fa40679c0 0x7f1fa4069e80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb8151480 0x7f1fb81507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb80b5540 0x7f1fb81502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 --2- 172.21.15.28:0/3893145318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fb80b32b0 0x7f1fb8155060 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 >> 172.21.15.28:0/3893145318 conn(0x7f1fb80cca50 msgr2=0x7f1fb806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 shutdown_connections 2024-09-15T22:56:31.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7f1f9d7fa640 1 -- 172.21.15.28:0/3893145318 wait complete. 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 msgr2=0x7fc6c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 0x7fc6c8069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009b10 tx=0x7fc6cc008040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 msgr2=0x7fc6dc0aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.720+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 0x7fc6dc0aa6e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bda0 tx=0x7fc6d400cad0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 shutdown_connections 2024-09-15T22:56:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6dc0afaa0 0x7fc6dc0aa6e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc6c80678c0 0x7fc6c8069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6dc148170 0x7fc6dc0af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 --2- 172.21.15.28:0/2670898887 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c4004810 0x7fc6dc1456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 >> 172.21.15.28:0/2670898887 conn(0x7fc6dc0cff90 msgr2=0x7fc6dc06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 shutdown_connections 2024-09-15T22:56:31.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.724+0000 7fc6e0a5e640 1 -- 172.21.15.28:0/2670898887 wait complete. 2024-09-15T22:56:31.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2024-09-15T22:56:31.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2024-09-15T22:56:31.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.760+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa5640abd40 con 0x7fa56406e170 2024-09-15T22:56:31.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.760+0000 7fa54b7fe640 1 -- 172.21.15.28:0/3268332718 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa56406ff40 con 0x7fa56406e170 2024-09-15T22:56:31.761 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2024-09-15T22:56:31.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.760+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd274005860 con 0x7fd29c0ce980 2024-09-15T22:56:31.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.760+0000 7fd2997fa640 1 -- 172.21.15.28:0/1982950483 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd28c0ba410 con 0x7fd29c0ce980 2024-09-15T22:56:31.763 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 msgr2=0x7fa54c069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 0x7fa54c069ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ad000 tx=0x7fa5580a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 msgr2=0x7fa5640aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c530 tx=0x7fa55400c9f0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 shutdown_connections 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa56415e7d0 0x7fa5640afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5641589f0 0x7fa5641571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa54c067a20 0x7fa54c069ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 --2- 172.21.15.28:0/3268332718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa56406e170 0x7fa5640aa900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 >> 172.21.15.28:0/3268332718 conn(0x7fa56406f120 msgr2=0x7fa564160270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 shutdown_connections 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fa563fff640 1 -- 172.21.15.28:0/3268332718 wait complete. 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 msgr2=0x7fd288069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 0x7fd288069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd290013fd0 tx=0x7fd290008040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 msgr2=0x7fd29c16cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c16cd90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b0000 tx=0x7fd28c01bd60 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 shutdown_connections 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd29c0ce980 0x7fd29c16cd90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2880678c0 0x7fd288069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd29c08c970 0x7fd29c165d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 --2- 172.21.15.28:0/1982950483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd29c06d300 0x7fd29c164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 >> 172.21.15.28:0/1982950483 conn(0x7fd29c0cca50 msgr2=0x7fd29c070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 shutdown_connections 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.764+0000 7fd282ffd640 1 -- 172.21.15.28:0/1982950483 wait complete. 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff54000a410 con 0x7ff540036bd0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff52f7fe640 1 -- 172.21.15.28:0/631278491 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff53c0f0560 con 0x7ff540036bd0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffa1c06dd80 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ffa127fc640 1 -- 172.21.15.28:0/2562519162 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa18055c60 con 0x7ffa1c06c7e0 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 msgr2=0x7ffa08069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 0x7ffa08069ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c15dbb0 tx=0x7ffa0c008040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 msgr2=0x7ffa1c0cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 0x7ffa1c0cd7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000f70 tx=0x7ffa1800c890 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 shutdown_connections 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa1c0b4c30 0x7ffa1c13e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ffa08067a20 0x7ffa08069ee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa1c0b47f0 0x7ffa1c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 --2- 172.21.15.28:0/2562519162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1c06c7e0 0x7ffa1c0cd7f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.772+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 >> 172.21.15.28:0/2562519162 conn(0x7ffa1c06bcc0 msgr2=0x7ffa1c0b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 msgr2=0x7ff534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 0x7ff534069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff548063860 tx=0x7ff54806bad0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 msgr2=0x7ff540100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff53c01cfc0 tx=0x7ff53c01b6b0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 shutdown_connections 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff9fffff640 1 -- 172.21.15.28:0/2562519162 wait complete. 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 shutdown_connections 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5400ffac0 0x7ff5400f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff540039c70 0x7ff5400f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 --2- 172.21.15.28:0/631278491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff540036bd0 0x7ff540100010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 >> 172.21.15.28:0/631278491 conn(0x7ff54001d940 msgr2=0x7ff540005600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 shutdown_connections 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7ff54c8cc640 1 -- 172.21.15.28:0/631278491 wait complete. 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7414005590 con 0x7f74340cdb90 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.776+0000 7f741bfff640 1 -- 172.21.15.28:0/2360631082 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74240ef300 con 0x7f74340cdb90 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f82d8005860 con 0x7f82e8054f50 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f82e67fc640 1 -- 172.21.15.28:0/2344837827 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82f016d270 con 0x7f82e8054f50 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2024-09-15T22:56:31.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 msgr2=0x7f7420069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 0x7f7420069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74340cd330 tx=0x7f7428007f20 comp rx=0 tx=0).stop 2024-09-15T22:56:31.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 msgr2=0x7f743414c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 0x7f743414c200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f74240ab000 tx=0x7f74240191b0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 shutdown_connections 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f743415e900 0x7f74341566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7420067990 0x7f7420069e50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74340cdfd0 0x7f743414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 --2- 172.21.15.28:0/2360631082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74340cdb90 0x7f743414c200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 >> 172.21.15.28:0/2360631082 conn(0x7f74340b2e10 msgr2=0x7f74340cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 shutdown_connections 2024-09-15T22:56:31.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.780+0000 7f7419ffb640 1 -- 172.21.15.28:0/2360631082 wait complete. 2024-09-15T22:56:31.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 msgr2=0x7f82d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 0x7f82d4069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82e804ae30 tx=0x7f82e0009040 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 msgr2=0x7f82e8008150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82f00693f0 tx=0x7f82f006bad0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 shutdown_connections 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82e80e4f00 0x7f82e80e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82d40678c0 0x7f82d4069d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82e8055330 0x7f82e804e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 --2- 172.21.15.28:0/2344837827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82e8054f50 0x7f82e8008150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 >> 172.21.15.28:0/2344837827 conn(0x7f82e80567c0 msgr2=0x7f82e8051340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 shutdown_connections 2024-09-15T22:56:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:31.784+0000 7f82f7ba3640 1 -- 172.21.15.28:0/2344837827 wait complete. 2024-09-15T22:56:31.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-09-15T22:56:31.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2024-09-15T22:56:31.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-09-15T22:56:31.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2024-09-15T22:56:31.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2024-09-15T22:56:31.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2024-09-15T22:56:32.750 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:56:32.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:56:32.797 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:56:32.800 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:56:32.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:56:32.809 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:56:32.809 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:56:32.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:56:32.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.892+0000 7feaee2c1640 1 Processor -- start 2024-09-15T22:56:32.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.892+0000 7feaee2c1640 1 -- start start 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feaee2c1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feae80cd570 0x7feae80cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feaee2c1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feae8151220 0x7feae80b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feaee2c1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae80ce370 con 0x7feae81516b0 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feaee2c1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7feae80b4040 con 0x7feae8151220 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feaee2c1640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feae80ce9c0 con 0x7feae80cd570 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feae8151220 0x7feae80b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feae8151220 0x7feae80b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44040/0 (socket says 172.21.15.28:44040) 2024-09-15T22:56:32.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 -- 172.21.15.28:0/3257317927 learned_addr learned my addr 172.21.15.28:0/3257317927 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:32.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 -- 172.21.15.28:0/3257317927 >> v2:172.21.15.131:3300/0 conn(0x7feae80cd570 msgr2=0x7feae80cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:32.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 --2- 172.21.15.28:0/3257317927 >> v2:172.21.15.131:3300/0 conn(0x7feae80cd570 0x7feae80cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 -- 172.21.15.28:0/3257317927 >> v1:172.21.15.131:6789/0 conn(0x7feae81516b0 legacy=0x7feae80b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.896+0000 7feae77fe640 1 -- 172.21.15.28:0/3257317927 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae80ce650 con 0x7feae8151220 2024-09-15T22:56:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feae77fe640 1 --2- 172.21.15.28:0/3257317927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae8151220 0x7feae80b5540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feae8069200 tx=0x7feae001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db9206053151d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feae6ffd640 1 -- 172.21.15.28:0/3257317927 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae00a57f0 con 0x7feae8151220 2024-09-15T22:56:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feae6ffd640 1 -- 172.21.15.28:0/3257317927 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae00a5990 con 0x7feae8151220 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 -- 172.21.15.28:0/3257317927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae8151220 msgr2=0x7feae80b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 --2- 172.21.15.28:0/3257317927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae8151220 0x7feae80b5540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feae8069200 tx=0x7feae001ca10 comp rx=0 tx=0).stop 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 -- 172.21.15.28:0/3257317927 shutdown_connections 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 --2- 172.21.15.28:0/3257317927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae8151220 0x7feae80b5540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 --2- 172.21.15.28:0/3257317927 >> v2:172.21.15.131:3300/0 conn(0x7feae80cd570 0x7feae80cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 -- 172.21.15.28:0/3257317927 >> 172.21.15.28:0/3257317927 conn(0x7feae80cca50 msgr2=0x7feae80cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.900+0000 7feaee2c1640 1 -- 172.21.15.28:0/3257317927 shutdown_connections 2024-09-15T22:56:32.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 -- 172.21.15.28:0/3257317927 wait complete. 2024-09-15T22:56:32.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 Processor -- start 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 -- start start 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feae80cd570 0x7feae8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feae8151220 0x7feae8204850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7feae806c860 con 0x7feae81516b0 2024-09-15T22:56:32.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feae806c6e0 con 0x7feae80cd570 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaee2c1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feae8152530 con 0x7feae8151220 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaec85e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaec85e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44054/0 (socket says 172.21.15.28:44054) 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feaec85e640 1 -- 172.21.15.28:0/834110333 learned_addr learned my addr 172.21.15.28:0/834110333 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feae7fff640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feae80cd570 0x7feae8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.904+0000 7feae77fe640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feae8151220 0x7feae8204850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 -- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feae8151220 msgr2=0x7feae8204850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feae8151220 0x7feae8204850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 -- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feae80cd570 msgr2=0x7feae8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feae80cd570 0x7feae8150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 -- 172.21.15.28:0/834110333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae81527b0 con 0x7feae81516b0 2024-09-15T22:56:32.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaec85e640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fead800c3c0 tx=0x7fead800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead80052d0 con 0x7feae81516b0 2024-09-15T22:56:32.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead8005470 con 0x7feae81516b0 2024-09-15T22:56:32.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8007240 con 0x7feae81516b0 2024-09-15T22:56:32.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaee2c1640 1 -- 172.21.15.28:0/834110333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae8152a90 con 0x7feae81516b0 2024-09-15T22:56:32.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.908+0000 7feaee2c1640 1 -- 172.21.15.28:0/834110333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81437e0 con 0x7feae81516b0 2024-09-15T22:56:32.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.912+0000 7feaee2c1640 1 -- 172.21.15.28:0/834110333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae80cee50 con 0x7feae81516b0 2024-09-15T22:56:32.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.912+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fead80073e0 con 0x7feae81516b0 2024-09-15T22:56:32.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.912+0000 7feae4ff9640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 0x7fead4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.912+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fead8084fa0 con 0x7feae81516b0 2024-09-15T22:56:32.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.912+0000 7feae7fff640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 0x7fead4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.916+0000 7feae7fff640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 0x7fead4069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feadc009990 tx=0x7feadc009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.920+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fead8001010 con 0x7feae81516b0 2024-09-15T22:56:32.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.920+0000 7f9399aa0640 1 Processor -- start 2024-09-15T22:56:32.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.920+0000 7f9399aa0640 1 -- start start 2024-09-15T22:56:32.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9399aa0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f93940cd590 0x7f93940cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9399aa0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93940b3750 con 0x7f9394151550 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9399aa0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93940b3a30 con 0x7f93940cf4f0 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9399aa0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9394151930 con 0x7f93940cd590 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f93937fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9394151550 0x7f93940b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58624/0 (socket says 172.21.15.28:58624) 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f93937fe640 1 -- 172.21.15.28:0/1448219889 learned_addr learned my addr 172.21.15.28:0/1448219889 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9392ffd640 1 --2- 172.21.15.28:0/1448219889 >> v2:172.21.15.28:3300/0 conn(0x7f93940cd590 0x7f93940cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f93927fc640 1 -- 172.21.15.28:0/1448219889 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345338852 0 0) 0x7f93940b3750 con 0x7f9394151550 2024-09-15T22:56:32.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f93927fc640 1 -- 172.21.15.28:0/1448219889 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f937c003530 con 0x7f9394151550 2024-09-15T22:56:32.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f93927fc640 1 -- 172.21.15.28:0/1448219889 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 795968389 0 0) 0x7f937c003530 con 0x7f9394151550 2024-09-15T22:56:32.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9392ffd640 1 -- 172.21.15.28:0/1448219889 >> v1:172.21.15.131:6789/0 conn(0x7f93940cf4f0 legacy=0x7f93940cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:32.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9392ffd640 1 -- 172.21.15.28:0/1448219889 >> v1:172.21.15.28:6789/0 conn(0x7f9394151550 legacy=0x7f93940b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.924+0000 7f9392ffd640 1 -- 172.21.15.28:0/1448219889 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940b3d10 con 0x7f93940cd590 2024-09-15T22:56:32.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.928+0000 7f9392ffd640 1 --2- 172.21.15.28:0/1448219889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93940cd590 0x7f93940cda00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93880087c0 tx=0x7f938801e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e658ae81f6f2f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.928+0000 7f93927fc640 1 -- 172.21.15.28:0/1448219889 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880ad070 con 0x7f93940cd590 2024-09-15T22:56:32.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.928+0000 7f93927fc640 1 -- 172.21.15.28:0/1448219889 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93880a7630 con 0x7f93940cd590 2024-09-15T22:56:32.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.928+0000 7f9399aa0640 1 -- 172.21.15.28:0/1448219889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93940cd590 msgr2=0x7f93940cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.928+0000 7f9399aa0640 1 --2- 172.21.15.28:0/1448219889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93940cd590 0x7f93940cda00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93880087c0 tx=0x7f938801e890 comp rx=0 tx=0).stop 2024-09-15T22:56:32.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- 172.21.15.28:0/1448219889 shutdown_connections 2024-09-15T22:56:32.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 --2- 172.21.15.28:0/1448219889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93940cd590 0x7f93940cda00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- 172.21.15.28:0/1448219889 >> 172.21.15.28:0/1448219889 conn(0x7f939406bcc0 msgr2=0x7f939406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:32.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- 172.21.15.28:0/1448219889 shutdown_connections 2024-09-15T22:56:32.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- 172.21.15.28:0/1448219889 wait complete. 2024-09-15T22:56:32.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 Processor -- start 2024-09-15T22:56:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- start start 2024-09-15T22:56:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93940cd590 0x7f939414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93940cf4f0 0x7f93940732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f939415b830 con 0x7f9394151550 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f93940cdf40 con 0x7f93940cd590 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.932+0000 7f9399aa0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9394073820 con 0x7f93940cf4f0 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44076/0 (socket says 172.21.15.28:44076) 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 -- 172.21.15.28:0/2751027569 learned_addr learned my addr 172.21.15.28:0/2751027569 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f93937fe640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93940cd590 0x7f939414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9392ffd640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93940cf4f0 0x7f93940732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 -- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93940cf4f0 msgr2=0x7f93940732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93940cf4f0 0x7f93940732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 -- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93940cd590 msgr2=0x7f939414e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93940cd590 0x7f939414e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 -- 172.21.15.28:0/2751027569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940b5450 con 0x7f9394151550 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9393fff640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f938400c440 tx=0x7f938400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384017070 con 0x7f9394151550 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9399aa0640 1 -- 172.21.15.28:0/2751027569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9394071f50 con 0x7f9394151550 2024-09-15T22:56:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.936+0000 7f9399aa0640 1 -- 172.21.15.28:0/2751027569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9394072510 con 0x7f9394151550 2024-09-15T22:56:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384003600 con 0x7f9394151550 2024-09-15T22:56:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840039f0 con 0x7f9394151550 2024-09-15T22:56:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f938401a070 con 0x7f9394151550 2024-09-15T22:56:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9383fff640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 0x7f9378069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f93937fe640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 0x7f9378069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f93840850d0 con 0x7f9394151550 2024-09-15T22:56:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.940+0000 7f9399aa0640 1 -- 172.21.15.28:0/2751027569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93700052a0 con 0x7f9394151550 2024-09-15T22:56:32.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.952+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93840555a0 con 0x7f9394151550 2024-09-15T22:56:32.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.952+0000 7f93937fe640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 0x7f9378069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f938c001570 tx=0x7f938c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.964+0000 7fa1d8597640 1 Processor -- start 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.964+0000 7fa1d8597640 1 -- start start 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d8597640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa1d0151480 0x7fa1d00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d8597640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d00b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d8597640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d00ce090 con 0x7fa1d00b5540 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d8597640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d00b4040 con 0x7fa1d0151480 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d8597640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d00ce9c0 con 0x7fa1d00b32b0 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d5b32640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa1d00b5540 0x7fa1d00b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58636/0 (socket says 172.21.15.28:58636) 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d5b32640 1 -- 172.21.15.28:0/2070737420 learned_addr learned my addr 172.21.15.28:0/2070737420 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:32.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6333640 1 --2- 172.21.15.28:0/2070737420 >> v2:172.21.15.28:3300/0 conn(0x7fa1d0151480 0x7fa1d00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/2070737420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d00b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6b34640 1 -- 172.21.15.28:0/2070737420 >> v2:172.21.15.28:3300/0 conn(0x7fa1d0151480 msgr2=0x7fa1d00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:32.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/2070737420 >> v2:172.21.15.28:3300/0 conn(0x7fa1d0151480 0x7fa1d00cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6b34640 1 -- 172.21.15.28:0/2070737420 >> v1:172.21.15.28:6789/0 conn(0x7fa1d00b5540 legacy=0x7fa1d00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.968+0000 7fa1d6b34640 1 -- 172.21.15.28:0/2070737420 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d00ce370 con 0x7fa1d00b32b0 2024-09-15T22:56:32.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/2070737420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d00b3720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00ba50 tx=0x7fa1cc01e770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a99d8673a358b30f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d5331640 1 -- 172.21.15.28:0/2070737420 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b0020 con 0x7fa1d00b32b0 2024-09-15T22:56:32.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d5331640 1 -- 172.21.15.28:0/2070737420 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0a86a0 con 0x7fa1d00b32b0 2024-09-15T22:56:32.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d5331640 1 -- 172.21.15.28:0/2070737420 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0a8ab0 con 0x7fa1d00b32b0 2024-09-15T22:56:32.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 -- 172.21.15.28:0/2070737420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 msgr2=0x7fa1d00b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 --2- 172.21.15.28:0/2070737420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d00b3720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00ba50 tx=0x7fa1cc01e770 comp rx=0 tx=0).stop 2024-09-15T22:56:32.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 -- 172.21.15.28:0/2070737420 shutdown_connections 2024-09-15T22:56:32.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 --2- 172.21.15.28:0/2070737420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d00b3720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 --2- 172.21.15.28:0/2070737420 >> v2:172.21.15.28:3300/0 conn(0x7fa1d0151480 0x7fa1d00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 -- 172.21.15.28:0/2070737420 >> 172.21.15.28:0/2070737420 conn(0x7fa1d00cca50 msgr2=0x7fa1d00cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:32.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 -- 172.21.15.28:0/2070737420 shutdown_connections 2024-09-15T22:56:32.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.972+0000 7fa1d8597640 1 -- 172.21.15.28:0/2070737420 wait complete. 2024-09-15T22:56:32.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 Processor -- start 2024-09-15T22:56:32.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 -- start start 2024-09-15T22:56:32.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 0x7fa1d0072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d5b32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 0x7fa1d0072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d5b32640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 0x7fa1d0072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:54270/0 (socket says 172.21.15.28:54270) 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d6b34640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d6b34640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44086/0 (socket says 172.21.15.28:44086) 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d6333640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d6333640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d0149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:40708/0 (socket says 172.21.15.28:40708) 2024-09-15T22:56:32.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006c650 con 0x7fa1d0151480 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006c4d0 con 0x7fa1d00b5540 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d8597640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d006c7d0 con 0x7fa1d00b32b0 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.976+0000 7fa1d5b32640 1 -- 172.21.15.28:0/1952494709 learned_addr learned my addr 172.21.15.28:0/1952494709 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 -- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 msgr2=0x7fa1d0149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d0149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 -- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 msgr2=0x7fa1d0072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:32.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 0x7fa1d0072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:32.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 -- 172.21.15.28:0/1952494709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d0160d20 con 0x7fa1d0151480 2024-09-15T22:56:32.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d6b34640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0ae000 tx=0x7fa1cc01b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0bb070 con 0x7fa1d0151480 2024-09-15T22:56:32.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d0160fc0 con 0x7fa1d0151480 2024-09-15T22:56:32.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.980+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d0161580 con 0x7fa1d0151480 2024-09-15T22:56:32.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0a9690 con 0x7fa1d0151480 2024-09-15T22:56:32.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b0040 con 0x7fa1d0151480 2024-09-15T22:56:32.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1cc0b3020 con 0x7fa1d0151480 2024-09-15T22:56:32.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1c6ffd640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 0x7fa1b4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:32.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1cc124060 con 0x7fa1d0151480 2024-09-15T22:56:32.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.984+0000 7fa1d6333640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 0x7fa1b4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:32.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.988+0000 7fa1d6333640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 0x7fa1b4069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0073960 tx=0x7fa1c0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:32.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.988+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b80052a0 con 0x7fa1d0151480 2024-09-15T22:56:32.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:32.996+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1cc018480 con 0x7fa1d0151480 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 Processor -- start 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 -- start start 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66dc06d300 0x7f66dc070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc06bd60 con 0x7f66dc071100 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f66dc06f340 con 0x7f66dc08c970 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.008+0000 7f66e33af640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f66dc06c000 con 0x7f66dc06d300 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e114b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e114b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44088/0 (socket says 172.21.15.28:44088) 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e114b640 1 -- 172.21.15.28:0/3595259495 learned_addr learned my addr 172.21.15.28:0/3595259495 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e094a640 1 --2- 172.21.15.28:0/3595259495 >> v2:172.21.15.131:3300/0 conn(0x7f66dc06d300 0x7f66dc070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99384596 0 0) 0x7f66dc06bd60 con 0x7f66dc071100 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c800bd40 con 0x7f66dc071100 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e094a640 1 -- 172.21.15.28:0/3595259495 >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 msgr2=0x7f66dc06cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3217882151 0 0) 0x7f66c800bd40 con 0x7f66dc071100 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e094a640 1 --2- 172.21.15.28:0/3595259495 >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e094a640 1 -- 172.21.15.28:0/3595259495 >> v1:172.21.15.28:6789/0 conn(0x7f66dc071100 legacy=0x7f66dc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e094a640 1 -- 172.21.15.28:0/3595259495 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc06c2e0 con 0x7f66dc06d300 2024-09-15T22:56:33.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.012+0000 7f66e114b640 1 --2- 172.21.15.28:0/3595259495 >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:33.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e094a640 1 --2- 172.21.15.28:0/3595259495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc06d300 0x7f66dc070bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0b2dc0 tx=0x7f66d801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573febb8ee1b2e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4001a20 con 0x7f66dc06d300 2024-09-15T22:56:33.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d800b0d0 con 0x7f66dc06d300 2024-09-15T22:56:33.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66d3fff640 1 -- 172.21.15.28:0/3595259495 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d80a89a0 con 0x7f66dc06d300 2024-09-15T22:56:33.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 -- 172.21.15.28:0/3595259495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc06d300 msgr2=0x7f66dc070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 --2- 172.21.15.28:0/3595259495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc06d300 0x7f66dc070bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0b2dc0 tx=0x7f66d801ec30 comp rx=0 tx=0).stop 2024-09-15T22:56:33.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 -- 172.21.15.28:0/3595259495 shutdown_connections 2024-09-15T22:56:33.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 --2- 172.21.15.28:0/3595259495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc06d300 0x7f66dc070bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 --2- 172.21.15.28:0/3595259495 >> v2:172.21.15.28:3300/0 conn(0x7f66dc08c970 0x7f66dc06cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 -- 172.21.15.28:0/3595259495 >> 172.21.15.28:0/3595259495 conn(0x7f66dc0cca50 msgr2=0x7f66dc0cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 -- 172.21.15.28:0/3595259495 shutdown_connections 2024-09-15T22:56:33.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.016+0000 7f66e33af640 1 -- 172.21.15.28:0/3595259495 wait complete. 2024-09-15T22:56:33.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 Processor -- start 2024-09-15T22:56:33.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 -- start start 2024-09-15T22:56:33.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 Processor -- start 2024-09-15T22:56:33.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528057350 0x7fa528038240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa528038780 0x7fa5280512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa52800bec0 con 0x7fa528035b90 2024-09-15T22:56:33.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa528050e10 con 0x7fa528038780 2024-09-15T22:56:33.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa53677f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa528038bb0 con 0x7fa528057350 2024-09-15T22:56:33.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa528038780 0x7fa5280512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa52f7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528057350 0x7fa528038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa528038780 0x7fa5280512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:54282/0 (socket says 172.21.15.28:54282) 2024-09-15T22:56:33.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 -- 172.21.15.28:0/1553854183 learned_addr learned my addr 172.21.15.28:0/1553854183 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 -- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528057350 msgr2=0x7fa528038240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 --2- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528057350 0x7fa528038240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 -- 172.21.15.28:0/1553854183 >> v1:172.21.15.28:6789/0 conn(0x7fa528035b90 legacy=0x7fa528009110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7fa534d1c640 1 -- 172.21.15.28:0/1553854183 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52800c1a0 con 0x7fa528038780 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 -- start start 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66dc06d300 0x7f66dc1fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc08c970 0x7f66dc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc08cd50 con 0x7f66dc06d300 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc06c8a0 con 0x7f66dc08c970 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e33af640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0cf090 con 0x7f66dc071100 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:40730/0 (socket says 172.21.15.28:40730) 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 -- 172.21.15.28:0/3924336297 learned_addr learned my addr 172.21.15.28:0/3924336297 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e194c640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc08c970 0x7f66dc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 -- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc08c970 msgr2=0x7f66dc0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc08c970 0x7f66dc0aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 -- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66dc06d300 msgr2=0x7f66dc1fe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66dc06d300 0x7f66dc1fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.020+0000 7f66e094a640 1 -- 172.21.15.28:0/3924336297 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc1fe620 con 0x7f66dc071100 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66e094a640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d801c8c0 tx=0x7f66d801ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d80a89b0 con 0x7f66dc071100 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d80a8b50 con 0x7f66dc071100 2024-09-15T22:56:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8003620 con 0x7f66dc071100 2024-09-15T22:56:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66e33af640 1 -- 172.21.15.28:0/3924336297 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc166e20 con 0x7f66dc071100 2024-09-15T22:56:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66e33af640 1 -- 172.21.15.28:0/3924336297 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc1673e0 con 0x7f66dc071100 2024-09-15T22:56:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 Processor -- start 2024-09-15T22:56:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 -- start start 2024-09-15T22:56:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7ff8f58f0640 1 Processor -- start 2024-09-15T22:56:33.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7ff8f58f0640 1 -- start start 2024-09-15T22:56:33.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7fa534d1c640 1 --2- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528038780 0x7fa5280512a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009870 tx=0x7fa51c01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67eaf179437c6ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7fa52effd640 1 -- 172.21.15.28:0/1553854183 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0b1070 con 0x7fa528038780 2024-09-15T22:56:33.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7fa52effd640 1 -- 172.21.15.28:0/1553854183 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c0ac630 con 0x7fa528038780 2024-09-15T22:56:33.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7fa52effd640 1 -- 172.21.15.28:0/1553854183 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0a8050 con 0x7fa528038780 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b64160320 0x7f4b64072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cb720 0x7f4b640b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b640b5c20 con 0x7f4b640cd440 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f4b64073890 con 0x7f4b64160320 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f4b6b6c5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4b640b45e0 con 0x7f4b640cb720 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528038780 msgr2=0x7fa5280512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 --2- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528038780 0x7fa5280512a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009870 tx=0x7fa51c01c520 comp rx=0 tx=0).stop 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f58f0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 0x7ff8e8006f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- 172.21.15.28:0/1553854183 shutdown_connections 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 --2- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528057350 0x7fa528038240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 --2- 172.21.15.28:0/1553854183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528038780 0x7fa5280512a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- 172.21.15.28:0/1553854183 >> 172.21.15.28:0/1553854183 conn(0x7fa5280567c0 msgr2=0x7fa528056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66d80c1020 con 0x7f66dc071100 2024-09-15T22:56:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc070bc0 con 0x7f66dc071100 2024-09-15T22:56:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f66d1ffb640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 0x7f66c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66d81231b0 con 0x7f66dc071100 2024-09-15T22:56:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f58f0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e8033c50 con 0x7ff8e8039260 2024-09-15T22:56:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f58f0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e8039820 con 0x7ff8e8033870 2024-09-15T22:56:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f58f0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80554b0 con 0x7ff8e8036740 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.024+0000 7fecb2e44640 1 Processor -- start 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 -- start start 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b64160320 0x7f4b64072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b64160320 0x7f4b64072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44116/0 (socket says 172.21.15.28:44116) 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 -- 172.21.15.28:0/2581996786 learned_addr learned my addr 172.21.15.28:0/2581996786 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b69c62640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cb720 0x7f4b640b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- 172.21.15.28:0/1553854183 shutdown_connections 2024-09-15T22:56:33.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f50ef640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff8e8039260 0x7ff8e80de200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58666/0 (socket says 172.21.15.28:58666) 2024-09-15T22:56:33.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8f50ef640 1 -- 172.21.15.28:0/1207988554 learned_addr learned my addr 172.21.15.28:0/1207988554 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:33.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f66e114b640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 0x7f66c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8effff640 1 --2- 172.21.15.28:0/1207988554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 0x7ff8e8006f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 -- 172.21.15.28:0/2581996786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cb720 msgr2=0x7f4b640b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cb720 0x7f4b640b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 -- 172.21.15.28:0/2581996786 >> v1:172.21.15.131:6789/0 conn(0x7f4b640cd440 legacy=0x7f4b6415fc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:56:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f4b68c60640 1 -- 172.21.15.28:0/2581996786 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b640cbb70 con 0x7f4b64160320 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8ef7fe640 1 -- 172.21.15.28:0/1207988554 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284667263 0 0) 0x7ff8e8033c50 con 0x7ff8e8039260 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8ef7fe640 1 -- 172.21.15.28:0/1207988554 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003530 con 0x7ff8e8039260 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7f66e114b640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 0x7f66c0069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009fd0 tx=0x7f66cc00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fecac0cd460 0x7fecac15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecac0b3000 0x7fecac0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecac0b3530 con 0x7fecac15a2b0 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fecac15b8b0 con 0x7fecac0b3000 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb2e44640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fecac0b3810 con 0x7fecac0cd460 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecac0b3000 0x7fecac0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecac0b3000 0x7fecac0ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44118/0 (socket says 172.21.15.28:44118) 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 -- 172.21.15.28:0/3439446904 learned_addr learned my addr 172.21.15.28:0/3439446904 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- 172.21.15.28:0/1553854183 wait complete. 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecabfff640 1 --2- 172.21.15.28:0/3439446904 >> v2:172.21.15.131:3300/0 conn(0x7fecac0cd460 0x7fecac15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 -- 172.21.15.28:0/3439446904 >> v2:172.21.15.131:3300/0 conn(0x7fecac0cd460 msgr2=0x7fecac15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 --2- 172.21.15.28:0/3439446904 >> v2:172.21.15.131:3300/0 conn(0x7fecac0cd460 0x7fecac15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 -- 172.21.15.28:0/3439446904 >> v1:172.21.15.131:6789/0 conn(0x7fecac15a2b0 legacy=0x7fecac0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fecb13e1640 1 -- 172.21.15.28:0/3439446904 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0b3af0 con 0x7fecac0b3000 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 Processor -- start 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8effff640 1 -- 172.21.15.28:0/1207988554 >> v1:172.21.15.131:6789/0 conn(0x7ff8e8033870 legacy=0x7ff8e8036030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8effff640 1 -- 172.21.15.28:0/1207988554 >> v1:172.21.15.28:6789/0 conn(0x7ff8e8039260 legacy=0x7ff8e80de200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7ff8effff640 1 -- 172.21.15.28:0/1207988554 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8039b00 con 0x7ff8e8036740 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.028+0000 7fa53677f640 1 -- start start 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 0x7fa5280dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528038780 0x7fa528055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa528052170 con 0x7fa528057350 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa528051ff0 con 0x7fa528035b90 2024-09-15T22:56:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa5280522f0 con 0x7fa528038780 2024-09-15T22:56:33.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b68c60640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b64072980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b64073a10 tx=0x7f4b5401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeae3cbc277aebf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44130/0 (socket says 172.21.15.28:44130) 2024-09-15T22:56:33.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 -- 172.21.15.28:0/549187353 learned_addr learned my addr 172.21.15.28:0/549187353 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52ffff640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 0x7fa5280dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52f7fe640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528038780 0x7fa528055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 -- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528038780 msgr2=0x7fa528055990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528038780 0x7fa528055990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 -- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 msgr2=0x7fa5280dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 0x7fa5280dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 -- 172.21.15.28:0/549187353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280e10a0 con 0x7fa528057350 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52ffff640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 0x7fa5280dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:33.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7ff8effff640 1 --2- 172.21.15.28:0/1207988554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 0x7ff8e8006f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0087f0 tx=0x7ff8dc01e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9fb7285ee4c78b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b5bfff640 1 -- 172.21.15.28:0/2581996786 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b540b0070 con 0x7f4b64160320 2024-09-15T22:56:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b5bfff640 1 -- 172.21.15.28:0/2581996786 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b540ab600 con 0x7f4b64160320 2024-09-15T22:56:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b5bfff640 1 -- 172.21.15.28:0/2581996786 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b540ab9d0 con 0x7f4b64160320 2024-09-15T22:56:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa534d1c640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa51c01abd0 tx=0x7fa51c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb13e1640 1 --2- 172.21.15.28:0/3439446904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0b3000 0x7fecac0ce2d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecac0afc40 tx=0x7feca401dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad77ddf47b480c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecab7fe640 1 -- 172.21.15.28:0/3439446904 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40a6bd0 con 0x7fecac0b3000 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecab7fe640 1 -- 172.21.15.28:0/3439446904 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca40a6d70 con 0x7fecac0b3000 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecab7fe640 1 -- 172.21.15.28:0/3439446904 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40ae610 con 0x7fecac0b3000 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2581996786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 msgr2=0x7f4b64072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b64072980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b64073a10 tx=0x7f4b5401c3e0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2581996786 shutdown_connections 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cb720 0x7f4b640b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2581996786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b64072980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2581996786 >> 172.21.15.28:0/2581996786 conn(0x7f4b640cdb50 msgr2=0x7f4b640cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 -- 172.21.15.28:0/3439446904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0b3000 msgr2=0x7fecac0ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 --2- 172.21.15.28:0/3439446904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0b3000 0x7fecac0ce2d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecac0afc40 tx=0x7feca401dec0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 -- 172.21.15.28:0/3439446904 shutdown_connections 2024-09-15T22:56:33.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 --2- 172.21.15.28:0/3439446904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0b3000 0x7fecac0ce2d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 --2- 172.21.15.28:0/3439446904 >> v2:172.21.15.131:3300/0 conn(0x7fecac0cd460 0x7fecac15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 -- 172.21.15.28:0/3439446904 >> 172.21.15.28:0/3439446904 conn(0x7fecac0b1ed0 msgr2=0x7fecac0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2581996786 shutdown_connections 2024-09-15T22:56:33.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 -- 172.21.15.28:0/3439446904 shutdown_connections 2024-09-15T22:56:33.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fecb2e44640 1 -- 172.21.15.28:0/3439446904 wait complete. 2024-09-15T22:56:33.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2581996786 wait complete. 2024-09-15T22:56:33.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0b1040 con 0x7fa528057350 2024-09-15T22:56:33.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c0bc070 con 0x7fa528057350 2024-09-15T22:56:33.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0a8040 con 0x7fa528057350 2024-09-15T22:56:33.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5280e1380 con 0x7fa528057350 2024-09-15T22:56:33.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.032+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52804dae0 con 0x7fa528057350 2024-09-15T22:56:33.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528051280 con 0x7fa528057350 2024-09-15T22:56:33.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 Processor -- start 2024-09-15T22:56:33.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 Processor -- start 2024-09-15T22:56:33.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 -- start start 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 -- start start 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecac0b3000 0x7fecac0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 0x7fecac203dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0cf3f0 con 0x7fecac0cd460 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0cf270 con 0x7fecac15a2b0 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb2e44640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fecac0cf570 con 0x7fecac0b3000 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44146/0 (socket says 172.21.15.28:44146) 2024-09-15T22:56:33.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 -- 172.21.15.28:0/101378909 learned_addr learned my addr 172.21.15.28:0/101378909 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 0x7f4b64204b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cd440 0x7f4b64156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b6415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb0be0640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecac0b3000 0x7fecac0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 -- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecac0b3000 msgr2=0x7fecac0ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecac0b3000 0x7fecac0ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 -- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 msgr2=0x7fecac203dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb13e1640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 0x7fecac203dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69461640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 0x7f4b64204b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69461640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 0x7f4b64204b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:54320/0 (socket says 172.21.15.28:54320) 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 0x7fecac203dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 -- 172.21.15.28:0/101378909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0ac710 con 0x7fecac0cd460 2024-09-15T22:56:33.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecb13e1640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 0x7fecac203dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:33.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b68c60640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cd440 0x7f4b64156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69461640 1 -- 172.21.15.28:0/2320166493 learned_addr learned my addr 172.21.15.28:0/2320166493 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b640b6bf0 con 0x7f4b64160320 2024-09-15T22:56:33.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4b640b5ec0 con 0x7f4b640cb720 2024-09-15T22:56:33.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7fecabfff640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c7f0 tx=0x7fec9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4b640b6d70 con 0x7f4b640cd440 2024-09-15T22:56:33.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b6415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 -- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cd440 msgr2=0x7f4b64156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cd440 0x7f4b64156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 -- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 msgr2=0x7f4b64204b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 0x7f4b64204b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.036+0000 7f4b69c62640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b64154f80 con 0x7f4b64160320 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7f4b69c62640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b6415b280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c007d90 tx=0x7f4b5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa51c0b5610 con 0x7fa528057350 2024-09-15T22:56:33.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7fa52cff9640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 0x7fa514069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7ff8ef7fe640 1 -- 172.21.15.28:0/1207988554 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0ad070 con 0x7ff8e8036740 2024-09-15T22:56:33.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa51c120470 con 0x7fa528057350 2024-09-15T22:56:33.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7ff8ef7fe640 1 -- 172.21.15.28:0/1207988554 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0a7970 con 0x7ff8e8036740 2024-09-15T22:56:33.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7ff8ef7fe640 1 -- 172.21.15.28:0/1207988554 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0a7d20 con 0x7ff8e8036740 2024-09-15T22:56:33.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66d80187f0 con 0x7f66dc071100 2024-09-15T22:56:33.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7fa52ffff640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 0x7fa514069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7fa52ffff640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 0x7fa514069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa524003eb0 tx=0x7fa524009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7ff8f58f0640 1 -- 172.21.15.28:0/1207988554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 msgr2=0x7ff8e8006f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.040+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/1207988554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 0x7ff8e8006f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0087f0 tx=0x7ff8dc01e9b0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa51c016110 con 0x7fa528057350 2024-09-15T22:56:33.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98015070 con 0x7fecac0cd460 2024-09-15T22:56:33.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac0ac9f0 con 0x7fecac0cd460 2024-09-15T22:56:33.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac152830 con 0x7fecac0cd460 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00edd0 con 0x7f4b64160320 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b64155260 con 0x7f4b64160320 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b64155820 con 0x7f4b64160320 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec98007a30 con 0x7fecac0cd460 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac0ce2b0 con 0x7fecac0cd460 2024-09-15T22:56:33.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.044+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9801f060 con 0x7fecac0cd460 2024-09-15T22:56:33.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b640b40a0 con 0x7f4b64160320 2024-09-15T22:56:33.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0039a0 con 0x7f4b64160320 2024-09-15T22:56:33.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c003d50 con 0x7f4b64160320 2024-09-15T22:56:33.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec98018070 con 0x7fecac0cd460 2024-09-15T22:56:33.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7feca97fa640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 0x7fec90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b5c01b020 con 0x7f4b64160320 2024-09-15T22:56:33.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fec98085e50 con 0x7fecac0cd460 2024-09-15T22:56:33.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.048+0000 7f4b59ffb640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 0x7f4b48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.052+0000 7fecb0be0640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 0x7fec90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.052+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b5c086c00 con 0x7f4b64160320 2024-09-15T22:56:33.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.052+0000 7f4b69461640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 0x7f4b48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.052+0000 7fecb0be0640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 0x7fec90069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feca000b810 tx=0x7feca0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.052+0000 7f4b69461640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 0x7f4b48069db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009a50 tx=0x7f4b60009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- 172.21.15.28:0/1207988554 shutdown_connections 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/1207988554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8036740 0x7ff8e8006f50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- 172.21.15.28:0/1207988554 >> 172.21.15.28:0/1207988554 conn(0x7ff8e801d940 msgr2=0x7ff8e80545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- 172.21.15.28:0/1207988554 shutdown_connections 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- 172.21.15.28:0/1207988554 wait complete. 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 Processor -- start 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- start start 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8033870 0x7ff8e80ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e8039260 0x7ff8e80e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80ec8c0 con 0x7ff8e8036740 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80ec740 con 0x7ff8e8039260 2024-09-15T22:56:33.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8effff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8f58f0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80eca40 con 0x7ff8e8033870 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8effff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44162/0 (socket says 172.21.15.28:44162) 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.056+0000 7ff8effff640 1 -- 172.21.15.28:0/3596104230 learned_addr learned my addr 172.21.15.28:0/3596104230 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8f48ee640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8033870 0x7ff8e80ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8f50ef640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e8039260 0x7ff8e80e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec98007e20 con 0x7fecac0cd460 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 -- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8033870 msgr2=0x7ff8e80ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8033870 0x7ff8e80ea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 -- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e8039260 msgr2=0x7ff8e80e04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e8039260 0x7ff8e80e04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 -- 172.21.15.28:0/3596104230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e80dac90 con 0x7ff8e8036740 2024-09-15T22:56:33.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.060+0000 7ff8effff640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc01c5e0 tx=0x7ff8dc01b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.068+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b5c0570f0 con 0x7f4b64160320 2024-09-15T22:56:33.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.072+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0be070 con 0x7ff8e8036740 2024-09-15T22:56:33.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.072+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e80daf00 con 0x7ff8e8036740 2024-09-15T22:56:33.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.072+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8dc008df0 con 0x7ff8e8036740 2024-09-15T22:56:33.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.072+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0ad070 con 0x7ff8e8036740 2024-09-15T22:56:33.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.072+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e80e1580 con 0x7ff8e8036740 2024-09-15T22:56:33.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8dc0c1070 con 0x7ff8e8036740 2024-09-15T22:56:33.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8ed7fa640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 0x7ff8d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8dc11f5e0 con 0x7ff8e8036740 2024-09-15T22:56:33.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8f48ee640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 0x7ff8d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8f48ee640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 0x7ff8d4069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4006fd0 tx=0x7ff8e4009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.076+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e8006f50 con 0x7ff8e8036740 2024-09-15T22:56:33.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.088+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8dc0185a0 con 0x7ff8e8036740 2024-09-15T22:56:33.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.252+0000 7feaee2c1640 1 -- 172.21.15.28:0/834110333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feae80cc3a0 con 0x7feae81516b0 2024-09-15T22:56:33.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feae4ff9640 1 -- 172.21.15.28:0/834110333 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fead8055470 con 0x7feae81516b0 2024-09-15T22:56:33.259 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 msgr2=0x7fead4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 0x7fead4069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feadc009990 tx=0x7feadc009110 comp rx=0 tx=0).stop 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 msgr2=0x7feae81432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fead800c3c0 tx=0x7fead800c880 comp rx=0 tx=0).stop 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 shutdown_connections 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.256+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feae81516b0 0x7feae81432a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feae8151220 0x7feae8204850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fead4067910 0x7fead4069dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 --2- 172.21.15.28:0/834110333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feae80cd570 0x7feae8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 >> 172.21.15.28:0/834110333 conn(0x7feae80cca50 msgr2=0x7feae8168880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 shutdown_connections 2024-09-15T22:56:33.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.260+0000 7feace7fc640 1 -- 172.21.15.28:0/834110333 wait complete. 2024-09-15T22:56:33.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.268+0000 7f9399aa0640 1 -- 172.21.15.28:0/2751027569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9370005590 con 0x7f9394151550 2024-09-15T22:56:33.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.268+0000 7f9383fff640 1 -- 172.21.15.28:0/2751027569 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93840598a0 con 0x7f9394151550 2024-09-15T22:56:33.273 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:33.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 msgr2=0x7f9378069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 0x7f9378069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f938c001570 tx=0x7f938c009040 comp rx=0 tx=0).stop 2024-09-15T22:56:33.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 msgr2=0x7f93940b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f938400c440 tx=0x7f938400c900 comp rx=0 tx=0).stop 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 shutdown_connections 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9394151550 0x7f93940b1320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93940cf4f0 0x7f93940732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f93780679c0 0x7f9378069e80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 --2- 172.21.15.28:0/2751027569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93940cd590 0x7f939414e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 >> 172.21.15.28:0/2751027569 conn(0x7f939406bcc0 msgr2=0x7f939406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 shutdown_connections 2024-09-15T22:56:33.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.272+0000 7f9381ffb640 1 -- 172.21.15.28:0/2751027569 wait complete. 2024-09-15T22:56:33.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-09-15T22:56:33.285 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-09-15T22:56:33.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.296+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa1b8005860 con 0x7fa1d0151480 2024-09-15T22:56:33.300 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.296+0000 7fa1c6ffd640 1 -- 172.21.15.28:0/1952494709 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1cc0efa60 con 0x7fa1d0151480 2024-09-15T22:56:33.300 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 msgr2=0x7fa1b4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 0x7fa1b4069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0073960 tx=0x7fa1c0009190 comp rx=0 tx=0).stop 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 msgr2=0x7fa1d0073290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0ae000 tx=0x7fa1cc01b510 comp rx=0 tx=0).stop 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 shutdown_connections 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d0151480 0x7fa1d0073290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa1b4067910 0x7fa1b4069dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1d00b5540 0x7fa1d0072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 --2- 172.21.15.28:0/1952494709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1d00b32b0 0x7fa1d0149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 >> 172.21.15.28:0/1952494709 conn(0x7fa1d00cca50 msgr2=0x7fa1d015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 shutdown_connections 2024-09-15T22:56:33.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.300+0000 7fa1d8597640 1 -- 172.21.15.28:0/1952494709 wait complete. 2024-09-15T22:56:33.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-15T22:56:33.318 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.332+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f66dc168760 con 0x7f66dc071100 2024-09-15T22:56:33.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.332+0000 7f66d1ffb640 1 -- 172.21.15.28:0/3924336297 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66d80f3cf0 con 0x7f66dc071100 2024-09-15T22:56:33.335 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 msgr2=0x7f66c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 0x7f66c0069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009fd0 tx=0x7f66cc00b040 comp rx=0 tx=0).stop 2024-09-15T22:56:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 msgr2=0x7f66dc166460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d801c8c0 tx=0x7f66d801ba30 comp rx=0 tx=0).stop 2024-09-15T22:56:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 shutdown_connections 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f66c00678c0 0x7f66c0069d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc08c970 0x7f66dc0aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc071100 0x7f66dc166460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 --2- 172.21.15.28:0/3924336297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66dc06d300 0x7f66dc1fe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 >> 172.21.15.28:0/3924336297 conn(0x7f66dc0cca50 msgr2=0x7f66dc0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 shutdown_connections 2024-09-15T22:56:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.336+0000 7f66c77fe640 1 -- 172.21.15.28:0/3924336297 wait complete. 2024-09-15T22:56:33.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-09-15T22:56:33.352 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa52800acf0 con 0x7fa528057350 2024-09-15T22:56:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa52cff9640 1 -- 172.21.15.28:0/549187353 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa51c0f0f90 con 0x7fa528057350 2024-09-15T22:56:33.381 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 msgr2=0x7fa514069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 0x7fa514069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa524003eb0 tx=0x7fa524009040 comp rx=0 tx=0).stop 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 msgr2=0x7fa528055ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa51c01abd0 tx=0x7fa51c0192c0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 shutdown_connections 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa528057350 0x7fa528055ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa528038780 0x7fa528055990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa514067910 0x7fa514069dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 --2- 172.21.15.28:0/549187353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa528035b90 0x7fa5280dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 >> 172.21.15.28:0/549187353 conn(0x7fa5280567c0 msgr2=0x7fa528037eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 shutdown_connections 2024-09-15T22:56:33.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.380+0000 7fa53677f640 1 -- 172.21.15.28:0/549187353 wait complete. 2024-09-15T22:56:33.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4b6406ecf0 con 0x7f4b64160320 2024-09-15T22:56:33.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b59ffb640 1 -- 172.21.15.28:0/2320166493 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b5c05b3f0 con 0x7f4b64160320 2024-09-15T22:56:33.390 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 msgr2=0x7f4b48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 0x7f4b48069db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009a50 tx=0x7f4b60009190 comp rx=0 tx=0).stop 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 msgr2=0x7f4b6415b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b6415b280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c007d90 tx=0x7f4b5c00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 shutdown_connections 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b64160320 0x7f4b6415b280 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b640cd440 0x7f4b64156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4b480678f0 0x7f4b48069db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 --2- 172.21.15.28:0/2320166493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b640cb720 0x7f4b64204b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 >> 172.21.15.28:0/2320166493 conn(0x7f4b640cdb50 msgr2=0x7f4b6406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 shutdown_connections 2024-09-15T22:56:33.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.388+0000 7f4b6b6c5640 1 -- 172.21.15.28:0/2320166493 wait complete. 2024-09-15T22:56:33.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.396+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fecac158bd0 con 0x7fecac0cd460 2024-09-15T22:56:33.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.396+0000 7feca97fa640 1 -- 172.21.15.28:0/101378909 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec98056970 con 0x7fecac0cd460 2024-09-15T22:56:33.399 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-09-15T22:56:33.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-15T22:56:33.400 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 msgr2=0x7fec90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 0x7fec90069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feca000b810 tx=0x7feca0008040 comp rx=0 tx=0).stop 2024-09-15T22:56:33.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 msgr2=0x7fecac0abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c7f0 tx=0x7fec9800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 shutdown_connections 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fec900678c0 0x7fec90069d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecac15a2b0 0x7fecac203dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecac0cd460 0x7fecac0abec0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 --2- 172.21.15.28:0/101378909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecac0b3000 0x7fecac0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 >> 172.21.15.28:0/101378909 conn(0x7fecac0b1ed0 msgr2=0x7fecac06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 shutdown_connections 2024-09-15T22:56:33.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.400+0000 7fecb2e44640 1 -- 172.21.15.28:0/101378909 wait complete. 2024-09-15T22:56:33.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-09-15T22:56:33.410 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-09-15T22:56:33.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.420+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff8e80e1750 con 0x7ff8e8036740 2024-09-15T22:56:33.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8ed7fa640 1 -- 172.21.15.28:0/3596104230 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8dc0efac0 con 0x7ff8e8036740 2024-09-15T22:56:33.424 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.425 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2024-09-15T22:56:33.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 msgr2=0x7ff8d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 0x7ff8d4069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4006fd0 tx=0x7ff8e4009060 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 msgr2=0x7ff8e80d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc01c5e0 tx=0x7ff8dc01b750 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 shutdown_connections 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff8d40678c0 0x7ff8d4069d80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8e8039260 0x7ff8e80e04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8e8036740 0x7ff8e80d5be0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 --2- 172.21.15.28:0/3596104230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8e8033870 0x7ff8e80ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 >> 172.21.15.28:0/3596104230 conn(0x7ff8e801d940 msgr2=0x7ff8e8036020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 shutdown_connections 2024-09-15T22:56:33.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.424+0000 7ff8f58f0640 1 -- 172.21.15.28:0/3596104230 wait complete. 2024-09-15T22:56:33.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-15T22:56:33.441 DEBUG:teuthology.parallel:result is None 2024-09-15T22:56:33.441 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:56:33.442 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:33.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.588+0000 7f29933b7640 1 Processor -- start 2024-09-15T22:56:33.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.588+0000 7f29933b7640 1 -- start start 2024-09-15T22:56:33.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f29933b7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f298c145970 0x7f298c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f29933b7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f29933b7640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c0d0960 con 0x7f298c0b2300 2024-09-15T22:56:33.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f29933b7640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0b2770 con 0x7f298c145970 2024-09-15T22:56:33.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f29933b7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0d0f20 con 0x7f298c0d0360 2024-09-15T22:56:33.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991153640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f298c145970 0x7f298c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2990952640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f298c0b2300 0x7f298c0cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:33122/0 (socket says 172.21.15.28:33122) 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991954640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2990952640 1 -- 172.21.15.28:0/1385285037 learned_addr learned my addr 172.21.15.28:0/1385285037 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f298bfff640 1 -- 172.21.15.28:0/1385285037 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238035263 0 0) 0x7f298c0d0960 con 0x7f298c0b2300 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f298bfff640 1 -- 172.21.15.28:0/1385285037 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2974003530 con 0x7f298c0b2300 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991153640 1 -- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 msgr2=0x7f298c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991153640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991153640 1 -- 172.21.15.28:0/1385285037 >> v1:172.21.15.131:6789/0 conn(0x7f298c0b2300 legacy=0x7f298c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991153640 1 -- 172.21.15.28:0/1385285037 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0d0c40 con 0x7f298c145970 2024-09-15T22:56:33.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.592+0000 7f2991954640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:33.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f2991153640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c145970 0x7f298c0b1dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29840097f0 tx=0x7f298401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe95b659b39a9b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f298bfff640 1 -- 172.21.15.28:0/1385285037 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840b0070 con 0x7f298c145970 2024-09-15T22:56:33.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f298bfff640 1 -- 172.21.15.28:0/1385285037 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29840ab600 con 0x7f298c145970 2024-09-15T22:56:33.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f298bfff640 1 -- 172.21.15.28:0/1385285037 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840ab9d0 con 0x7f298c145970 2024-09-15T22:56:33.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 -- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c145970 msgr2=0x7f298c0b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c145970 0x7f298c0b1dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29840097f0 tx=0x7f298401c410 comp rx=0 tx=0).stop 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 -- 172.21.15.28:0/1385285037 shutdown_connections 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 --2- 172.21.15.28:0/1385285037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c145970 0x7f298c0b1dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 -- 172.21.15.28:0/1385285037 >> 172.21.15.28:0/1385285037 conn(0x7f298c06bcc0 msgr2=0x7f298c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 -- 172.21.15.28:0/1385285037 shutdown_connections 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.596+0000 7f29933b7640 1 -- 172.21.15.28:0/1385285037 wait complete. 2024-09-15T22:56:33.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 Processor -- start 2024-09-15T22:56:33.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- start start 2024-09-15T22:56:33.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c0b2300 0x7f298c0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0ceb90 con 0x7f298c145970 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0cea10 con 0x7f298c0b2300 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0ced10 con 0x7f298c0d0360 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44178/0 (socket says 172.21.15.28:44178) 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 -- 172.21.15.28:0/951096999 learned_addr learned my addr 172.21.15.28:0/951096999 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991153640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c0b2300 0x7f298c0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 -- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 msgr2=0x7f298c13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2990952640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c13ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 -- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c0b2300 msgr2=0x7f298c0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c0b2300 0x7f298c0c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 -- 172.21.15.28:0/951096999 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0c6c80 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2990952640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991954640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e930 tx=0x7f297c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c017070 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c004020 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c13f7c0 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c004430 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c0ca530 con 0x7f298c145970 2024-09-15T22:56:33.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c13f5b0 con 0x7f298c145970 2024-09-15T22:56:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f297c00c940 con 0x7f298c145970 2024-09-15T22:56:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 0x7f2978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f297c085fa0 con 0x7f298c145970 2024-09-15T22:56:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.600+0000 7f2991153640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 0x7f2978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.604+0000 7f2991153640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 0x7f2978069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29840ad000 tx=0x7f29840a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.604+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f297c0569d0 con 0x7f298c145970 2024-09-15T22:56:33.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.760+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f298c0af820 con 0x7f29780678c0 2024-09-15T22:56:33.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.772+0000 7f2989ffb640 1 -- 172.21.15.28:0/951096999 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f298c0af820 con 0x7f29780678c0 2024-09-15T22:56:33.775 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 msgr2=0x7f2978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 0x7f2978069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29840ad000 tx=0x7f29840a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 msgr2=0x7f298c13ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e930 tx=0x7f297c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 shutdown_connections 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c145970 0x7f298c13ef80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f298c0d0360 0x7f298c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f29780678c0 0x7f2978069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 --2- 172.21.15.28:0/951096999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c0b2300 0x7f298c0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 >> 172.21.15.28:0/951096999 conn(0x7f298c06bcc0 msgr2=0x7f298c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 shutdown_connections 2024-09-15T22:56:33.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.776+0000 7f29933b7640 1 -- 172.21.15.28:0/951096999 wait complete. 2024-09-15T22:56:33.792 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T22:56:31.869950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002851"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180547+0000","last_change":"2024-09-15T22:56:21.056451+0000","last_active":"2024-09-15T22:56:23.180547+0000","last_peered":"2024-09-15T22:56:23.180547+0000","last_clean":"2024-09-15T22:56:23.180547+0000","last_became_active":"2024-09-15T22:56:21.056145+0000","last_became_peered":"2024-09-15T22:56:21.056145+0000","last_unstale":"2024-09-15T22:56:23.180547+0000","last_undegraded":"2024-09-15T22:56:23.180547+0000","last_fullsized":"2024-09-15T22:56:23.180547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003947+0000","last_change":"2024-09-15T22:56:21.032126+0000","last_active":"2024-09-15T22:56:22.003947+0000","last_peered":"2024-09-15T22:56:22.003947+0000","last_clean":"2024-09-15T22:56:22.003947+0000","last_became_active":"2024-09-15T22:56:21.031366+0000","last_became_peered":"2024-09-15T22:56:21.031366+0000","last_unstale":"2024-09-15T22:56:22.003947+0000","last_undegraded":"2024-09-15T22:56:22.003947+0000","last_fullsized":"2024-09-15T22:56:22.003947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142427+0000","last_change":"2024-09-15T22:56:21.019102+0000","last_active":"2024-09-15T22:56:22.142427+0000","last_peered":"2024-09-15T22:56:22.142427+0000","last_clean":"2024-09-15T22:56:22.142427+0000","last_became_active":"2024-09-15T22:56:21.018279+0000","last_became_peered":"2024-09-15T22:56:21.018279+0000","last_unstale":"2024-09-15T22:56:22.142427+0000","last_undegraded":"2024-09-15T22:56:22.142427+0000","last_fullsized":"2024-09-15T22:56:22.142427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005366+0000","last_change":"2024-09-15T22:56:21.038401+0000","last_active":"2024-09-15T22:56:22.005366+0000","last_peered":"2024-09-15T22:56:22.005366+0000","last_clean":"2024-09-15T22:56:22.005366+0000","last_became_active":"2024-09-15T22:56:21.037254+0000","last_became_peered":"2024-09-15T22:56:21.037254+0000","last_unstale":"2024-09-15T22:56:22.005366+0000","last_undegraded":"2024-09-15T22:56:22.005366+0000","last_fullsized":"2024-09-15T22:56:22.005366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180159+0000","last_change":"2024-09-15T22:56:21.045620+0000","last_active":"2024-09-15T22:56:23.180159+0000","last_peered":"2024-09-15T22:56:23.180159+0000","last_clean":"2024-09-15T22:56:23.180159+0000","last_became_active":"2024-09-15T22:56:21.044268+0000","last_became_peered":"2024-09-15T22:56:21.044268+0000","last_unstale":"2024-09-15T22:56:23.180159+0000","last_undegraded":"2024-09-15T22:56:23.180159+0000","last_fullsized":"2024-09-15T22:56:23.180159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006657+0000","last_change":"2024-09-15T22:56:21.032910+0000","last_active":"2024-09-15T22:56:22.006657+0000","last_peered":"2024-09-15T22:56:22.006657+0000","last_clean":"2024-09-15T22:56:22.006657+0000","last_became_active":"2024-09-15T22:56:21.032121+0000","last_became_peered":"2024-09-15T22:56:21.032121+0000","last_unstale":"2024-09-15T22:56:22.006657+0000","last_undegraded":"2024-09-15T22:56:22.006657+0000","last_fullsized":"2024-09-15T22:56:22.006657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179615+0000","last_change":"2024-09-15T22:56:21.040858+0000","last_active":"2024-09-15T22:56:23.179615+0000","last_peered":"2024-09-15T22:56:23.179615+0000","last_clean":"2024-09-15T22:56:23.179615+0000","last_became_active":"2024-09-15T22:56:21.040118+0000","last_became_peered":"2024-09-15T22:56:21.040118+0000","last_unstale":"2024-09-15T22:56:23.179615+0000","last_undegraded":"2024-09-15T22:56:23.179615+0000","last_fullsized":"2024-09-15T22:56:23.179615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216724+0000","last_change":"2024-09-15T22:56:21.045328+0000","last_active":"2024-09-15T22:56:22.216724+0000","last_peered":"2024-09-15T22:56:22.216724+0000","last_clean":"2024-09-15T22:56:22.216724+0000","last_became_active":"2024-09-15T22:56:21.041149+0000","last_became_peered":"2024-09-15T22:56:21.041149+0000","last_unstale":"2024-09-15T22:56:22.216724+0000","last_undegraded":"2024-09-15T22:56:22.216724+0000","last_fullsized":"2024-09-15T22:56:22.216724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180976+0000","last_change":"2024-09-15T22:56:21.050262+0000","last_active":"2024-09-15T22:56:23.180976+0000","last_peered":"2024-09-15T22:56:23.180976+0000","last_clean":"2024-09-15T22:56:23.180976+0000","last_became_active":"2024-09-15T22:56:21.049947+0000","last_became_peered":"2024-09-15T22:56:21.049947+0000","last_unstale":"2024-09-15T22:56:23.180976+0000","last_undegraded":"2024-09-15T22:56:23.180976+0000","last_fullsized":"2024-09-15T22:56:23.180976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:10.140812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050907+0000","last_change":"2024-09-15T22:56:21.047268+0000","last_active":"2024-09-15T22:56:22.050907+0000","last_peered":"2024-09-15T22:56:22.050907+0000","last_clean":"2024-09-15T22:56:22.050907+0000","last_became_active":"2024-09-15T22:56:21.037053+0000","last_became_peered":"2024-09-15T22:56:21.037053+0000","last_unstale":"2024-09-15T22:56:22.050907+0000","last_undegraded":"2024-09-15T22:56:22.050907+0000","last_fullsized":"2024-09-15T22:56:22.050907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050656+0000","last_change":"2024-09-15T22:56:21.025979+0000","last_active":"2024-09-15T22:56:22.050656+0000","last_peered":"2024-09-15T22:56:22.050656+0000","last_clean":"2024-09-15T22:56:22.050656+0000","last_became_active":"2024-09-15T22:56:21.025244+0000","last_became_peered":"2024-09-15T22:56:21.025244+0000","last_unstale":"2024-09-15T22:56:22.050656+0000","last_undegraded":"2024-09-15T22:56:22.050656+0000","last_fullsized":"2024-09-15T22:56:22.050656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009445+0000","last_change":"2024-09-15T22:56:21.048891+0000","last_active":"2024-09-15T22:56:22.009445+0000","last_peered":"2024-09-15T22:56:22.009445+0000","last_clean":"2024-09-15T22:56:22.009445+0000","last_became_active":"2024-09-15T22:56:21.047867+0000","last_became_peered":"2024-09-15T22:56:21.047867+0000","last_unstale":"2024-09-15T22:56:22.009445+0000","last_undegraded":"2024-09-15T22:56:22.009445+0000","last_fullsized":"2024-09-15T22:56:22.009445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217499+0000","last_change":"2024-09-15T22:56:21.040543+0000","last_active":"2024-09-15T22:56:22.217499+0000","last_peered":"2024-09-15T22:56:22.217499+0000","last_clean":"2024-09-15T22:56:22.217499+0000","last_became_active":"2024-09-15T22:56:21.037513+0000","last_became_peered":"2024-09-15T22:56:21.037513+0000","last_unstale":"2024-09-15T22:56:22.217499+0000","last_undegraded":"2024-09-15T22:56:22.217499+0000","last_fullsized":"2024-09-15T22:56:22.217499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141539+0000","last_change":"2024-09-15T22:56:21.030445+0000","last_active":"2024-09-15T22:56:22.141539+0000","last_peered":"2024-09-15T22:56:22.141539+0000","last_clean":"2024-09-15T22:56:22.141539+0000","last_became_active":"2024-09-15T22:56:21.029183+0000","last_became_peered":"2024-09-15T22:56:21.029183+0000","last_unstale":"2024-09-15T22:56:22.141539+0000","last_undegraded":"2024-09-15T22:56:22.141539+0000","last_fullsized":"2024-09-15T22:56:22.141539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:25.498214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003208+0000","last_change":"2024-09-15T22:56:21.060226+0000","last_active":"2024-09-15T22:56:22.003208+0000","last_peered":"2024-09-15T22:56:22.003208+0000","last_clean":"2024-09-15T22:56:22.003208+0000","last_became_active":"2024-09-15T22:56:21.059278+0000","last_became_peered":"2024-09-15T22:56:21.059278+0000","last_unstale":"2024-09-15T22:56:22.003208+0000","last_undegraded":"2024-09-15T22:56:22.003208+0000","last_fullsized":"2024-09-15T22:56:22.003208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005250+0000","last_change":"2024-09-15T22:56:21.031563+0000","last_active":"2024-09-15T22:56:22.005250+0000","last_peered":"2024-09-15T22:56:22.005250+0000","last_clean":"2024-09-15T22:56:22.005250+0000","last_became_active":"2024-09-15T22:56:21.030766+0000","last_became_peered":"2024-09-15T22:56:21.030766+0000","last_unstale":"2024-09-15T22:56:22.005250+0000","last_undegraded":"2024-09-15T22:56:22.005250+0000","last_fullsized":"2024-09-15T22:56:22.005250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006836+0000","last_change":"2024-09-15T22:56:21.027156+0000","last_active":"2024-09-15T22:56:22.006836+0000","last_peered":"2024-09-15T22:56:22.006836+0000","last_clean":"2024-09-15T22:56:22.006836+0000","last_became_active":"2024-09-15T22:56:21.026524+0000","last_became_peered":"2024-09-15T22:56:21.026524+0000","last_unstale":"2024-09-15T22:56:22.006836+0000","last_undegraded":"2024-09-15T22:56:22.006836+0000","last_fullsized":"2024-09-15T22:56:22.006836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179333+0000","last_change":"2024-09-15T22:56:21.026616+0000","last_active":"2024-09-15T22:56:23.179333+0000","last_peered":"2024-09-15T22:56:23.179333+0000","last_clean":"2024-09-15T22:56:23.179333+0000","last_became_active":"2024-09-15T22:56:21.025720+0000","last_became_peered":"2024-09-15T22:56:21.025720+0000","last_unstale":"2024-09-15T22:56:23.179333+0000","last_undegraded":"2024-09-15T22:56:23.179333+0000","last_fullsized":"2024-09-15T22:56:23.179333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180750+0000","last_change":"2024-09-15T22:56:21.050095+0000","last_active":"2024-09-15T22:56:23.180750+0000","last_peered":"2024-09-15T22:56:23.180750+0000","last_clean":"2024-09-15T22:56:23.180750+0000","last_became_active":"2024-09-15T22:56:21.049818+0000","last_became_peered":"2024-09-15T22:56:21.049818+0000","last_unstale":"2024-09-15T22:56:23.180750+0000","last_undegraded":"2024-09-15T22:56:23.180750+0000","last_fullsized":"2024-09-15T22:56:23.180750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:38.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051010+0000","last_change":"2024-09-15T22:56:21.060371+0000","last_active":"2024-09-15T22:56:22.051010+0000","last_peered":"2024-09-15T22:56:22.051010+0000","last_clean":"2024-09-15T22:56:22.051010+0000","last_became_active":"2024-09-15T22:56:21.060056+0000","last_became_peered":"2024-09-15T22:56:21.060056+0000","last_unstale":"2024-09-15T22:56:22.051010+0000","last_undegraded":"2024-09-15T22:56:22.051010+0000","last_fullsized":"2024-09-15T22:56:22.051010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141782+0000","last_change":"2024-09-15T22:56:21.032143+0000","last_active":"2024-09-15T22:56:22.141782+0000","last_peered":"2024-09-15T22:56:22.141782+0000","last_clean":"2024-09-15T22:56:22.141782+0000","last_became_active":"2024-09-15T22:56:21.029384+0000","last_became_peered":"2024-09-15T22:56:21.029384+0000","last_unstale":"2024-09-15T22:56:22.141782+0000","last_undegraded":"2024-09-15T22:56:22.141782+0000","last_fullsized":"2024-09-15T22:56:22.141782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006884+0000","last_change":"2024-09-15T22:56:21.033531+0000","last_active":"2024-09-15T22:56:22.006884+0000","last_peered":"2024-09-15T22:56:22.006884+0000","last_clean":"2024-09-15T22:56:22.006884+0000","last_became_active":"2024-09-15T22:56:21.028976+0000","last_became_peered":"2024-09-15T22:56:21.028976+0000","last_unstale":"2024-09-15T22:56:22.006884+0000","last_undegraded":"2024-09-15T22:56:22.006884+0000","last_fullsized":"2024-09-15T22:56:22.006884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216872+0000","last_change":"2024-09-15T22:56:21.062713+0000","last_active":"2024-09-15T22:56:22.216872+0000","last_peered":"2024-09-15T22:56:22.216872+0000","last_clean":"2024-09-15T22:56:22.216872+0000","last_became_active":"2024-09-15T22:56:21.062258+0000","last_became_peered":"2024-09-15T22:56:21.062258+0000","last_unstale":"2024-09-15T22:56:22.216872+0000","last_undegraded":"2024-09-15T22:56:22.216872+0000","last_fullsized":"2024-09-15T22:56:22.216872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005697+0000","last_change":"2024-09-15T22:56:21.036717+0000","last_active":"2024-09-15T22:56:22.005697+0000","last_peered":"2024-09-15T22:56:22.005697+0000","last_clean":"2024-09-15T22:56:22.005697+0000","last_became_active":"2024-09-15T22:56:21.035818+0000","last_became_peered":"2024-09-15T22:56:21.035818+0000","last_unstale":"2024-09-15T22:56:22.005697+0000","last_undegraded":"2024-09-15T22:56:22.005697+0000","last_fullsized":"2024-09-15T22:56:22.005697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218073+0000","last_change":"2024-09-15T22:56:21.050243+0000","last_active":"2024-09-15T22:56:22.218073+0000","last_peered":"2024-09-15T22:56:22.218073+0000","last_clean":"2024-09-15T22:56:22.218073+0000","last_became_active":"2024-09-15T22:56:21.049811+0000","last_became_peered":"2024-09-15T22:56:21.049811+0000","last_unstale":"2024-09-15T22:56:22.218073+0000","last_undegraded":"2024-09-15T22:56:22.218073+0000","last_fullsized":"2024-09-15T22:56:22.218073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051051+0000","last_change":"2024-09-15T22:56:21.034983+0000","last_active":"2024-09-15T22:56:22.051051+0000","last_peered":"2024-09-15T22:56:22.051051+0000","last_clean":"2024-09-15T22:56:22.051051+0000","last_became_active":"2024-09-15T22:56:21.034274+0000","last_became_peered":"2024-09-15T22:56:21.034274+0000","last_unstale":"2024-09-15T22:56:22.051051+0000","last_undegraded":"2024-09-15T22:56:22.051051+0000","last_fullsized":"2024-09-15T22:56:22.051051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003271+0000","last_change":"2024-09-15T22:56:21.039395+0000","last_active":"2024-09-15T22:56:22.003271+0000","last_peered":"2024-09-15T22:56:22.003271+0000","last_clean":"2024-09-15T22:56:22.003271+0000","last_became_active":"2024-09-15T22:56:21.039113+0000","last_became_peered":"2024-09-15T22:56:21.039113+0000","last_unstale":"2024-09-15T22:56:22.003271+0000","last_undegraded":"2024-09-15T22:56:22.003271+0000","last_fullsized":"2024-09-15T22:56:22.003271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217763+0000","last_change":"2024-09-15T22:56:21.062629+0000","last_active":"2024-09-15T22:56:22.217763+0000","last_peered":"2024-09-15T22:56:22.217763+0000","last_clean":"2024-09-15T22:56:22.217763+0000","last_became_active":"2024-09-15T22:56:21.062301+0000","last_became_peered":"2024-09-15T22:56:21.062301+0000","last_unstale":"2024-09-15T22:56:22.217763+0000","last_undegraded":"2024-09-15T22:56:22.217763+0000","last_fullsized":"2024-09-15T22:56:22.217763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142003+0000","last_change":"2024-09-15T22:56:21.036927+0000","last_active":"2024-09-15T22:56:22.142003+0000","last_peered":"2024-09-15T22:56:22.142003+0000","last_clean":"2024-09-15T22:56:22.142003+0000","last_became_active":"2024-09-15T22:56:21.036612+0000","last_became_peered":"2024-09-15T22:56:21.036612+0000","last_unstale":"2024-09-15T22:56:22.142003+0000","last_undegraded":"2024-09-15T22:56:22.142003+0000","last_fullsized":"2024-09-15T22:56:22.142003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007140+0000","last_change":"2024-09-15T22:56:21.039825+0000","last_active":"2024-09-15T22:56:22.007140+0000","last_peered":"2024-09-15T22:56:22.007140+0000","last_clean":"2024-09-15T22:56:22.007140+0000","last_became_active":"2024-09-15T22:56:21.038388+0000","last_became_peered":"2024-09-15T22:56:21.038388+0000","last_unstale":"2024-09-15T22:56:22.007140+0000","last_undegraded":"2024-09-15T22:56:22.007140+0000","last_fullsized":"2024-09-15T22:56:22.007140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179235+0000","last_change":"2024-09-15T22:56:21.018597+0000","last_active":"2024-09-15T22:56:23.179235+0000","last_peered":"2024-09-15T22:56:23.179235+0000","last_clean":"2024-09-15T22:56:23.179235+0000","last_became_active":"2024-09-15T22:56:21.017870+0000","last_became_peered":"2024-09-15T22:56:21.017870+0000","last_unstale":"2024-09-15T22:56:23.179235+0000","last_undegraded":"2024-09-15T22:56:23.179235+0000","last_fullsized":"2024-09-15T22:56:23.179235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050354+0000","last_change":"2024-09-15T22:56:21.035519+0000","last_active":"2024-09-15T22:56:22.050354+0000","last_peered":"2024-09-15T22:56:22.050354+0000","last_clean":"2024-09-15T22:56:22.050354+0000","last_became_active":"2024-09-15T22:56:21.033628+0000","last_became_peered":"2024-09-15T22:56:21.033628+0000","last_unstale":"2024-09-15T22:56:22.050354+0000","last_undegraded":"2024-09-15T22:56:22.050354+0000","last_fullsized":"2024-09-15T22:56:22.050354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008297+0000","last_change":"2024-09-15T22:56:21.042927+0000","last_active":"2024-09-15T22:56:22.008297+0000","last_peered":"2024-09-15T22:56:22.008297+0000","last_clean":"2024-09-15T22:56:22.008297+0000","last_became_active":"2024-09-15T22:56:21.042371+0000","last_became_peered":"2024-09-15T22:56:21.042371+0000","last_unstale":"2024-09-15T22:56:22.008297+0000","last_undegraded":"2024-09-15T22:56:22.008297+0000","last_fullsized":"2024-09-15T22:56:22.008297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:47.722424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217741+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:22.217741+0000","last_peered":"2024-09-15T22:56:22.217741+0000","last_clean":"2024-09-15T22:56:22.217741+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:22.217741+0000","last_undegraded":"2024-09-15T22:56:22.217741+0000","last_fullsized":"2024-09-15T22:56:22.217741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142010+0000","last_change":"2024-09-15T22:56:21.051815+0000","last_active":"2024-09-15T22:56:22.142010+0000","last_peered":"2024-09-15T22:56:22.142010+0000","last_clean":"2024-09-15T22:56:22.142010+0000","last_became_active":"2024-09-15T22:56:21.051533+0000","last_became_peered":"2024-09-15T22:56:21.051533+0000","last_unstale":"2024-09-15T22:56:22.142010+0000","last_undegraded":"2024-09-15T22:56:22.142010+0000","last_fullsized":"2024-09-15T22:56:22.142010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050312+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:22.050312+0000","last_peered":"2024-09-15T22:56:22.050312+0000","last_clean":"2024-09-15T22:56:22.050312+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:22.050312+0000","last_undegraded":"2024-09-15T22:56:22.050312+0000","last_fullsized":"2024-09-15T22:56:22.050312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217152+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:22.217152+0000","last_peered":"2024-09-15T22:56:22.217152+0000","last_clean":"2024-09-15T22:56:22.217152+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:22.217152+0000","last_undegraded":"2024-09-15T22:56:22.217152+0000","last_fullsized":"2024-09-15T22:56:22.217152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216948+0000","last_change":"2024-09-15T22:56:21.037092+0000","last_active":"2024-09-15T22:56:22.216948+0000","last_peered":"2024-09-15T22:56:22.216948+0000","last_clean":"2024-09-15T22:56:22.216948+0000","last_became_active":"2024-09-15T22:56:21.036262+0000","last_became_peered":"2024-09-15T22:56:21.036262+0000","last_unstale":"2024-09-15T22:56:22.216948+0000","last_undegraded":"2024-09-15T22:56:22.216948+0000","last_fullsized":"2024-09-15T22:56:22.216948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005951+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:22.005951+0000","last_peered":"2024-09-15T22:56:22.005951+0000","last_clean":"2024-09-15T22:56:22.005951+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:22.005951+0000","last_undegraded":"2024-09-15T22:56:22.005951+0000","last_fullsized":"2024-09-15T22:56:22.005951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003006+0000","last_change":"2024-09-15T22:56:21.038747+0000","last_active":"2024-09-15T22:56:22.003006+0000","last_peered":"2024-09-15T22:56:22.003006+0000","last_clean":"2024-09-15T22:56:22.003006+0000","last_became_active":"2024-09-15T22:56:21.038452+0000","last_became_peered":"2024-09-15T22:56:21.038452+0000","last_unstale":"2024-09-15T22:56:22.003006+0000","last_undegraded":"2024-09-15T22:56:22.003006+0000","last_fullsized":"2024-09-15T22:56:22.003006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050686+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:22.050686+0000","last_peered":"2024-09-15T22:56:22.050686+0000","last_clean":"2024-09-15T22:56:22.050686+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:22.050686+0000","last_undegraded":"2024-09-15T22:56:22.050686+0000","last_fullsized":"2024-09-15T22:56:22.050686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005757+0000","last_change":"2024-09-15T22:56:21.025007+0000","last_active":"2024-09-15T22:56:22.005757+0000","last_peered":"2024-09-15T22:56:22.005757+0000","last_clean":"2024-09-15T22:56:22.005757+0000","last_became_active":"2024-09-15T22:56:21.023970+0000","last_became_peered":"2024-09-15T22:56:21.023970+0000","last_unstale":"2024-09-15T22:56:22.005757+0000","last_undegraded":"2024-09-15T22:56:22.005757+0000","last_fullsized":"2024-09-15T22:56:22.005757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005763+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:22.005763+0000","last_peered":"2024-09-15T22:56:22.005763+0000","last_clean":"2024-09-15T22:56:22.005763+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:22.005763+0000","last_undegraded":"2024-09-15T22:56:22.005763+0000","last_fullsized":"2024-09-15T22:56:22.005763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142513+0000","last_change":"2024-09-15T22:56:21.029548+0000","last_active":"2024-09-15T22:56:22.142513+0000","last_peered":"2024-09-15T22:56:22.142513+0000","last_clean":"2024-09-15T22:56:22.142513+0000","last_became_active":"2024-09-15T22:56:21.028802+0000","last_became_peered":"2024-09-15T22:56:21.028802+0000","last_unstale":"2024-09-15T22:56:22.142513+0000","last_undegraded":"2024-09-15T22:56:22.142513+0000","last_fullsized":"2024-09-15T22:56:22.142513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003341+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:22.003341+0000","last_peered":"2024-09-15T22:56:22.003341+0000","last_clean":"2024-09-15T22:56:22.003341+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:22.003341+0000","last_undegraded":"2024-09-15T22:56:22.003341+0000","last_fullsized":"2024-09-15T22:56:22.003341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009002+0000","last_change":"2024-09-15T22:56:21.055834+0000","last_active":"2024-09-15T22:56:22.009002+0000","last_peered":"2024-09-15T22:56:22.009002+0000","last_clean":"2024-09-15T22:56:22.009002+0000","last_became_active":"2024-09-15T22:56:21.049855+0000","last_became_peered":"2024-09-15T22:56:21.049855+0000","last_unstale":"2024-09-15T22:56:22.009002+0000","last_undegraded":"2024-09-15T22:56:22.009002+0000","last_fullsized":"2024-09-15T22:56:22.009002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:11.763410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050975+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:22.050975+0000","last_peered":"2024-09-15T22:56:22.050975+0000","last_clean":"2024-09-15T22:56:22.050975+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:22.050975+0000","last_undegraded":"2024-09-15T22:56:22.050975+0000","last_fullsized":"2024-09-15T22:56:22.050975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180006+0000","last_change":"2024-09-15T22:56:21.046560+0000","last_active":"2024-09-15T22:56:23.180006+0000","last_peered":"2024-09-15T22:56:23.180006+0000","last_clean":"2024-09-15T22:56:23.180006+0000","last_became_active":"2024-09-15T22:56:21.045861+0000","last_became_peered":"2024-09-15T22:56:21.045861+0000","last_unstale":"2024-09-15T22:56:23.180006+0000","last_undegraded":"2024-09-15T22:56:23.180006+0000","last_fullsized":"2024-09-15T22:56:23.180006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142150+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:22.142150+0000","last_peered":"2024-09-15T22:56:22.142150+0000","last_clean":"2024-09-15T22:56:22.142150+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:22.142150+0000","last_undegraded":"2024-09-15T22:56:22.142150+0000","last_fullsized":"2024-09-15T22:56:22.142150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141682+0000","last_change":"2024-09-15T22:56:21.030324+0000","last_active":"2024-09-15T22:56:22.141682+0000","last_peered":"2024-09-15T22:56:22.141682+0000","last_clean":"2024-09-15T22:56:22.141682+0000","last_became_active":"2024-09-15T22:56:21.029364+0000","last_became_peered":"2024-09-15T22:56:21.029364+0000","last_unstale":"2024-09-15T22:56:22.141682+0000","last_undegraded":"2024-09-15T22:56:22.141682+0000","last_fullsized":"2024-09-15T22:56:22.141682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007313+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:22.007313+0000","last_peered":"2024-09-15T22:56:22.007313+0000","last_clean":"2024-09-15T22:56:22.007313+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:22.007313+0000","last_undegraded":"2024-09-15T22:56:22.007313+0000","last_fullsized":"2024-09-15T22:56:22.007313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180348+0000","last_change":"2024-09-15T22:56:21.059175+0000","last_active":"2024-09-15T22:56:23.180348+0000","last_peered":"2024-09-15T22:56:23.180348+0000","last_clean":"2024-09-15T22:56:23.180348+0000","last_became_active":"2024-09-15T22:56:21.058849+0000","last_became_peered":"2024-09-15T22:56:21.058849+0000","last_unstale":"2024-09-15T22:56:23.180348+0000","last_undegraded":"2024-09-15T22:56:23.180348+0000","last_fullsized":"2024-09-15T22:56:23.180348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050178+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:22.050178+0000","last_peered":"2024-09-15T22:56:22.050178+0000","last_clean":"2024-09-15T22:56:22.050178+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:22.050178+0000","last_undegraded":"2024-09-15T22:56:22.050178+0000","last_fullsized":"2024-09-15T22:56:22.050178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050382+0000","last_change":"2024-09-15T22:56:21.034329+0000","last_active":"2024-09-15T22:56:22.050382+0000","last_peered":"2024-09-15T22:56:22.050382+0000","last_clean":"2024-09-15T22:56:22.050382+0000","last_became_active":"2024-09-15T22:56:21.032155+0000","last_became_peered":"2024-09-15T22:56:21.032155+0000","last_unstale":"2024-09-15T22:56:22.050382+0000","last_undegraded":"2024-09-15T22:56:22.050382+0000","last_fullsized":"2024-09-15T22:56:22.050382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179149+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:23.179149+0000","last_peered":"2024-09-15T22:56:23.179149+0000","last_clean":"2024-09-15T22:56:23.179149+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:23.179149+0000","last_undegraded":"2024-09-15T22:56:23.179149+0000","last_fullsized":"2024-09-15T22:56:23.179149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179693+0000","last_change":"2024-09-15T22:56:21.060727+0000","last_active":"2024-09-15T22:56:23.179693+0000","last_peered":"2024-09-15T22:56:23.179693+0000","last_clean":"2024-09-15T22:56:23.179693+0000","last_became_active":"2024-09-15T22:56:21.060316+0000","last_became_peered":"2024-09-15T22:56:21.060316+0000","last_unstale":"2024-09-15T22:56:23.179693+0000","last_undegraded":"2024-09-15T22:56:23.179693+0000","last_fullsized":"2024-09-15T22:56:23.179693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009262+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:22.009262+0000","last_peered":"2024-09-15T22:56:22.009262+0000","last_clean":"2024-09-15T22:56:22.009262+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:22.009262+0000","last_undegraded":"2024-09-15T22:56:22.009262+0000","last_fullsized":"2024-09-15T22:56:22.009262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180646+0000","last_change":"2024-09-15T22:56:21.061277+0000","last_active":"2024-09-15T22:56:23.180646+0000","last_peered":"2024-09-15T22:56:23.180646+0000","last_clean":"2024-09-15T22:56:23.180646+0000","last_became_active":"2024-09-15T22:56:21.061012+0000","last_became_peered":"2024-09-15T22:56:21.061012+0000","last_unstale":"2024-09-15T22:56:23.180646+0000","last_undegraded":"2024-09-15T22:56:23.180646+0000","last_fullsized":"2024-09-15T22:56:23.180646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.747289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179357+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:23.179357+0000","last_peered":"2024-09-15T22:56:23.179357+0000","last_clean":"2024-09-15T22:56:23.179357+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:23.179357+0000","last_undegraded":"2024-09-15T22:56:23.179357+0000","last_fullsized":"2024-09-15T22:56:23.179357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.181081+0000","last_change":"2024-09-15T22:56:21.061243+0000","last_active":"2024-09-15T22:56:23.181081+0000","last_peered":"2024-09-15T22:56:23.181081+0000","last_clean":"2024-09-15T22:56:23.181081+0000","last_became_active":"2024-09-15T22:56:21.060909+0000","last_became_peered":"2024-09-15T22:56:21.060909+0000","last_unstale":"2024-09-15T22:56:23.181081+0000","last_undegraded":"2024-09-15T22:56:23.181081+0000","last_fullsized":"2024-09-15T22:56:23.181081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:42.598011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003379+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:22.003379+0000","last_peered":"2024-09-15T22:56:22.003379+0000","last_clean":"2024-09-15T22:56:22.003379+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:22.003379+0000","last_undegraded":"2024-09-15T22:56:22.003379+0000","last_fullsized":"2024-09-15T22:56:22.003379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005819+0000","last_change":"2024-09-15T22:56:21.037223+0000","last_active":"2024-09-15T22:56:22.005819+0000","last_peered":"2024-09-15T22:56:22.005819+0000","last_clean":"2024-09-15T22:56:22.005819+0000","last_became_active":"2024-09-15T22:56:21.036206+0000","last_became_peered":"2024-09-15T22:56:21.036206+0000","last_unstale":"2024-09-15T22:56:22.005819+0000","last_undegraded":"2024-09-15T22:56:22.005819+0000","last_fullsized":"2024-09-15T22:56:22.005819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179520+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:23.179520+0000","last_peered":"2024-09-15T22:56:23.179520+0000","last_clean":"2024-09-15T22:56:23.179520+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:23.179520+0000","last_undegraded":"2024-09-15T22:56:23.179520+0000","last_fullsized":"2024-09-15T22:56:23.179520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180199+0000","last_change":"2024-09-15T22:56:21.046827+0000","last_active":"2024-09-15T22:56:23.180199+0000","last_peered":"2024-09-15T22:56:23.180199+0000","last_clean":"2024-09-15T22:56:23.180199+0000","last_became_active":"2024-09-15T22:56:21.046257+0000","last_became_peered":"2024-09-15T22:56:21.046257+0000","last_unstale":"2024-09-15T22:56:23.180199+0000","last_undegraded":"2024-09-15T22:56:23.180199+0000","last_fullsized":"2024-09-15T22:56:23.180199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179789+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:23.179789+0000","last_peered":"2024-09-15T22:56:23.179789+0000","last_clean":"2024-09-15T22:56:23.179789+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:23.179789+0000","last_undegraded":"2024-09-15T22:56:23.179789+0000","last_fullsized":"2024-09-15T22:56:23.179789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005089+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:22.005089+0000","last_peered":"2024-09-15T22:56:22.005089+0000","last_clean":"2024-09-15T22:56:22.005089+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:22.005089+0000","last_undegraded":"2024-09-15T22:56:22.005089+0000","last_fullsized":"2024-09-15T22:56:22.005089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217092+0000","last_change":"2024-09-15T22:56:21.037507+0000","last_active":"2024-09-15T22:56:22.217092+0000","last_peered":"2024-09-15T22:56:22.217092+0000","last_clean":"2024-09-15T22:56:22.217092+0000","last_became_active":"2024-09-15T22:56:21.036694+0000","last_became_peered":"2024-09-15T22:56:21.036694+0000","last_unstale":"2024-09-15T22:56:22.217092+0000","last_undegraded":"2024-09-15T22:56:22.217092+0000","last_fullsized":"2024-09-15T22:56:22.217092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179425+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:23.179425+0000","last_peered":"2024-09-15T22:56:23.179425+0000","last_clean":"2024-09-15T22:56:23.179425+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:23.179425+0000","last_undegraded":"2024-09-15T22:56:23.179425+0000","last_fullsized":"2024-09-15T22:56:23.179425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141425+0000","last_change":"2024-09-15T22:56:21.059613+0000","last_active":"2024-09-15T22:56:22.141425+0000","last_peered":"2024-09-15T22:56:22.141425+0000","last_clean":"2024-09-15T22:56:22.141425+0000","last_became_active":"2024-09-15T22:56:21.059232+0000","last_became_peered":"2024-09-15T22:56:21.059232+0000","last_unstale":"2024-09-15T22:56:22.141425+0000","last_undegraded":"2024-09-15T22:56:22.141425+0000","last_fullsized":"2024-09-15T22:56:22.141425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:27.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179315+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:23.179315+0000","last_peered":"2024-09-15T22:56:23.179315+0000","last_clean":"2024-09-15T22:56:23.179315+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:23.179315+0000","last_undegraded":"2024-09-15T22:56:23.179315+0000","last_fullsized":"2024-09-15T22:56:23.179315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003288+0000","last_change":"2024-09-15T22:56:21.025917+0000","last_active":"2024-09-15T22:56:22.003288+0000","last_peered":"2024-09-15T22:56:22.003288+0000","last_clean":"2024-09-15T22:56:22.003288+0000","last_became_active":"2024-09-15T22:56:21.024942+0000","last_became_peered":"2024-09-15T22:56:21.024942+0000","last_unstale":"2024-09-15T22:56:22.003288+0000","last_undegraded":"2024-09-15T22:56:22.003288+0000","last_fullsized":"2024-09-15T22:56:22.003288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007443+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:22.007443+0000","last_peered":"2024-09-15T22:56:22.007443+0000","last_clean":"2024-09-15T22:56:22.007443+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:22.007443+0000","last_undegraded":"2024-09-15T22:56:22.007443+0000","last_fullsized":"2024-09-15T22:56:22.007443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008636+0000","last_change":"2024-09-15T22:56:21.048376+0000","last_active":"2024-09-15T22:56:22.008636+0000","last_peered":"2024-09-15T22:56:22.008636+0000","last_clean":"2024-09-15T22:56:22.008636+0000","last_became_active":"2024-09-15T22:56:21.044757+0000","last_became_peered":"2024-09-15T22:56:21.044757+0000","last_unstale":"2024-09-15T22:56:22.008636+0000","last_undegraded":"2024-09-15T22:56:22.008636+0000","last_fullsized":"2024-09-15T22:56:22.008636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004374+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:22.004374+0000","last_peered":"2024-09-15T22:56:22.004374+0000","last_clean":"2024-09-15T22:56:22.004374+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:22.004374+0000","last_undegraded":"2024-09-15T22:56:22.004374+0000","last_fullsized":"2024-09-15T22:56:22.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006284+0000","last_change":"2024-09-15T22:56:21.037003+0000","last_active":"2024-09-15T22:56:22.006284+0000","last_peered":"2024-09-15T22:56:22.006284+0000","last_clean":"2024-09-15T22:56:22.006284+0000","last_became_active":"2024-09-15T22:56:21.036088+0000","last_became_peered":"2024-09-15T22:56:21.036088+0000","last_unstale":"2024-09-15T22:56:22.006284+0000","last_undegraded":"2024-09-15T22:56:22.006284+0000","last_fullsized":"2024-09-15T22:56:22.006284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180792+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:23.180792+0000","last_peered":"2024-09-15T22:56:23.180792+0000","last_clean":"2024-09-15T22:56:23.180792+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:23.180792+0000","last_undegraded":"2024-09-15T22:56:23.180792+0000","last_fullsized":"2024-09-15T22:56:23.180792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:51.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004381+0000","last_change":"2024-09-15T22:56:21.027999+0000","last_active":"2024-09-15T22:56:22.004381+0000","last_peered":"2024-09-15T22:56:22.004381+0000","last_clean":"2024-09-15T22:56:22.004381+0000","last_became_active":"2024-09-15T22:56:21.027045+0000","last_became_peered":"2024-09-15T22:56:21.027045+0000","last_unstale":"2024-09-15T22:56:22.004381+0000","last_undegraded":"2024-09-15T22:56:22.004381+0000","last_fullsized":"2024-09-15T22:56:22.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004145+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:22.004145+0000","last_peered":"2024-09-15T22:56:22.004145+0000","last_clean":"2024-09-15T22:56:22.004145+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:22.004145+0000","last_undegraded":"2024-09-15T22:56:22.004145+0000","last_fullsized":"2024-09-15T22:56:22.004145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218282+0000","last_change":"2024-09-15T22:56:21.047660+0000","last_active":"2024-09-15T22:56:22.218282+0000","last_peered":"2024-09-15T22:56:22.218282+0000","last_clean":"2024-09-15T22:56:22.218282+0000","last_became_active":"2024-09-15T22:56:21.046792+0000","last_became_peered":"2024-09-15T22:56:21.046792+0000","last_unstale":"2024-09-15T22:56:22.218282+0000","last_undegraded":"2024-09-15T22:56:22.218282+0000","last_fullsized":"2024-09-15T22:56:22.218282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050772+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:22.050772+0000","last_peered":"2024-09-15T22:56:22.050772+0000","last_clean":"2024-09-15T22:56:22.050772+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:22.050772+0000","last_undegraded":"2024-09-15T22:56:22.050772+0000","last_fullsized":"2024-09-15T22:56:22.050772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142574+0000","last_change":"2024-09-15T22:56:21.023902+0000","last_active":"2024-09-15T22:56:22.142574+0000","last_peered":"2024-09-15T22:56:22.142574+0000","last_clean":"2024-09-15T22:56:22.142574+0000","last_became_active":"2024-09-15T22:56:21.022501+0000","last_became_peered":"2024-09-15T22:56:21.022501+0000","last_unstale":"2024-09-15T22:56:22.142574+0000","last_undegraded":"2024-09-15T22:56:22.142574+0000","last_fullsized":"2024-09-15T22:56:22.142574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179422+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:23.179422+0000","last_peered":"2024-09-15T22:56:23.179422+0000","last_clean":"2024-09-15T22:56:23.179422+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:23.179422+0000","last_undegraded":"2024-09-15T22:56:23.179422+0000","last_fullsized":"2024-09-15T22:56:23.179422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008423+0000","last_change":"2024-09-15T22:56:21.057092+0000","last_active":"2024-09-15T22:56:22.008423+0000","last_peered":"2024-09-15T22:56:22.008423+0000","last_clean":"2024-09-15T22:56:22.008423+0000","last_became_active":"2024-09-15T22:56:21.044676+0000","last_became_peered":"2024-09-15T22:56:21.044676+0000","last_unstale":"2024-09-15T22:56:22.008423+0000","last_undegraded":"2024-09-15T22:56:22.008423+0000","last_fullsized":"2024-09-15T22:56:22.008423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003472+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:22.003472+0000","last_peered":"2024-09-15T22:56:22.003472+0000","last_clean":"2024-09-15T22:56:22.003472+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:22.003472+0000","last_undegraded":"2024-09-15T22:56:22.003472+0000","last_fullsized":"2024-09-15T22:56:22.003472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217176+0000","last_change":"2024-09-15T22:56:21.035548+0000","last_active":"2024-09-15T22:56:22.217176+0000","last_peered":"2024-09-15T22:56:22.217176+0000","last_clean":"2024-09-15T22:56:22.217176+0000","last_became_active":"2024-09-15T22:56:21.030034+0000","last_became_peered":"2024-09-15T22:56:21.030034+0000","last_unstale":"2024-09-15T22:56:22.217176+0000","last_undegraded":"2024-09-15T22:56:22.217176+0000","last_fullsized":"2024-09-15T22:56:22.217176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003541+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:22.003541+0000","last_peered":"2024-09-15T22:56:22.003541+0000","last_clean":"2024-09-15T22:56:22.003541+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:22.003541+0000","last_undegraded":"2024-09-15T22:56:22.003541+0000","last_fullsized":"2024-09-15T22:56:22.003541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217560+0000","last_change":"2024-09-15T22:56:21.036761+0000","last_active":"2024-09-15T22:56:22.217560+0000","last_peered":"2024-09-15T22:56:22.217560+0000","last_clean":"2024-09-15T22:56:22.217560+0000","last_became_active":"2024-09-15T22:56:21.036060+0000","last_became_peered":"2024-09-15T22:56:21.036060+0000","last_unstale":"2024-09-15T22:56:22.217560+0000","last_undegraded":"2024-09-15T22:56:22.217560+0000","last_fullsized":"2024-09-15T22:56:22.217560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180453+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:23.180453+0000","last_peered":"2024-09-15T22:56:23.180453+0000","last_clean":"2024-09-15T22:56:23.180453+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:23.180453+0000","last_undegraded":"2024-09-15T22:56:23.180453+0000","last_fullsized":"2024-09-15T22:56:23.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050392+0000","last_change":"2024-09-15T22:56:21.049096+0000","last_active":"2024-09-15T22:56:22.050392+0000","last_peered":"2024-09-15T22:56:22.050392+0000","last_clean":"2024-09-15T22:56:22.050392+0000","last_became_active":"2024-09-15T22:56:21.048786+0000","last_became_peered":"2024-09-15T22:56:21.048786+0000","last_unstale":"2024-09-15T22:56:22.050392+0000","last_undegraded":"2024-09-15T22:56:22.050392+0000","last_fullsized":"2024-09-15T22:56:22.050392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006067+0000","last_change":"2024-09-15T22:56:21.057906+0000","last_active":"2024-09-15T22:56:22.006067+0000","last_peered":"2024-09-15T22:56:22.006067+0000","last_clean":"2024-09-15T22:56:22.006067+0000","last_became_active":"2024-09-15T22:56:21.057525+0000","last_became_peered":"2024-09-15T22:56:21.057525+0000","last_unstale":"2024-09-15T22:56:22.006067+0000","last_undegraded":"2024-09-15T22:56:22.006067+0000","last_fullsized":"2024-09-15T22:56:22.006067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180598+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:23.180598+0000","last_peered":"2024-09-15T22:56:23.180598+0000","last_clean":"2024-09-15T22:56:23.180598+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:23.180598+0000","last_undegraded":"2024-09-15T22:56:23.180598+0000","last_fullsized":"2024-09-15T22:56:23.180598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.753562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005745+0000","last_change":"2024-09-15T22:56:21.058064+0000","last_active":"2024-09-15T22:56:22.005745+0000","last_peered":"2024-09-15T22:56:22.005745+0000","last_clean":"2024-09-15T22:56:22.005745+0000","last_became_active":"2024-09-15T22:56:21.057542+0000","last_became_peered":"2024-09-15T22:56:21.057542+0000","last_unstale":"2024-09-15T22:56:22.005745+0000","last_undegraded":"2024-09-15T22:56:22.005745+0000","last_fullsized":"2024-09-15T22:56:22.005745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180466+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:23.180466+0000","last_peered":"2024-09-15T22:56:23.180466+0000","last_clean":"2024-09-15T22:56:23.180466+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:23.180466+0000","last_undegraded":"2024-09-15T22:56:23.180466+0000","last_fullsized":"2024-09-15T22:56:23.180466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:31.596992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142530+0000","last_change":"2024-09-15T22:56:21.033186+0000","last_active":"2024-09-15T22:56:22.142530+0000","last_peered":"2024-09-15T22:56:22.142530+0000","last_clean":"2024-09-15T22:56:22.142530+0000","last_became_active":"2024-09-15T22:56:21.030711+0000","last_became_peered":"2024-09-15T22:56:21.030711+0000","last_unstale":"2024-09-15T22:56:22.142530+0000","last_undegraded":"2024-09-15T22:56:22.142530+0000","last_fullsized":"2024-09-15T22:56:22.142530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218077+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:22.218077+0000","last_peered":"2024-09-15T22:56:22.218077+0000","last_clean":"2024-09-15T22:56:22.218077+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:22.218077+0000","last_undegraded":"2024-09-15T22:56:22.218077+0000","last_fullsized":"2024-09-15T22:56:22.218077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217920+0000","last_change":"2024-09-15T22:56:21.063433+0000","last_active":"2024-09-15T22:56:22.217920+0000","last_peered":"2024-09-15T22:56:22.217920+0000","last_clean":"2024-09-15T22:56:22.217920+0000","last_became_active":"2024-09-15T22:56:21.062367+0000","last_became_peered":"2024-09-15T22:56:21.062367+0000","last_unstale":"2024-09-15T22:56:22.217920+0000","last_undegraded":"2024-09-15T22:56:22.217920+0000","last_fullsized":"2024-09-15T22:56:22.217920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142732+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:22.142732+0000","last_peered":"2024-09-15T22:56:22.142732+0000","last_clean":"2024-09-15T22:56:22.142732+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:22.142732+0000","last_undegraded":"2024-09-15T22:56:22.142732+0000","last_fullsized":"2024-09-15T22:56:22.142732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:33.796 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:56:33.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 Processor -- start 2024-09-15T22:56:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 -- start start 2024-09-15T22:56:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff2800b24d0 0x7ff2800cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2800d0190 0x7ff2800cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2800d0960 con 0x7ff280145970 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff2800d0f20 con 0x7ff2800b24d0 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff2854f9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff2800cd620 con 0x7ff2800d0190 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff2800b24d0 0x7ff2800cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff280145970 0x7ff2800b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58678/0 (socket says 172.21.15.28:58678) 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27effd640 1 -- 172.21.15.28:0/3032830112 learned_addr learned my addr 172.21.15.28:0/3032830112 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27f7fe640 1 --2- 172.21.15.28:0/3032830112 >> v2:172.21.15.131:3300/0 conn(0x7ff2800d0190 0x7ff2800cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 -- 172.21.15.28:0/3032830112 >> v2:172.21.15.131:3300/0 conn(0x7ff2800d0190 msgr2=0x7ff2800cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 --2- 172.21.15.28:0/3032830112 >> v2:172.21.15.131:3300/0 conn(0x7ff2800d0190 0x7ff2800cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 -- 172.21.15.28:0/3032830112 >> v1:172.21.15.28:6789/0 conn(0x7ff280145970 legacy=0x7ff2800b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 -- 172.21.15.28:0/3032830112 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800d0c40 con 0x7ff2800b24d0 2024-09-15T22:56:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff277fff640 1 --2- 172.21.15.28:0/3032830112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff2800cfc50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff28006cbd0 tx=0x7ff26801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c766921ba06dab79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27e7fc640 1 -- 172.21.15.28:0/3032830112 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2680b0070 con 0x7ff2800b24d0 2024-09-15T22:56:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27e7fc640 1 -- 172.21.15.28:0/3032830112 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2680ab600 con 0x7ff2800b24d0 2024-09-15T22:56:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.952+0000 7ff27e7fc640 1 -- 172.21.15.28:0/3032830112 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2680ab9d0 con 0x7ff2800b24d0 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- 172.21.15.28:0/3032830112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 msgr2=0x7ff2800cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- 172.21.15.28:0/3032830112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff2800cfc50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff28006cbd0 tx=0x7ff26801c3c0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- 172.21.15.28:0/3032830112 shutdown_connections 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- 172.21.15.28:0/3032830112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff2800cfc50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- 172.21.15.28:0/3032830112 >> v2:172.21.15.131:3300/0 conn(0x7ff2800d0190 0x7ff2800cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- 172.21.15.28:0/3032830112 >> 172.21.15.28:0/3032830112 conn(0x7ff28006bcc0 msgr2=0x7ff28006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- 172.21.15.28:0/3032830112 shutdown_connections 2024-09-15T22:56:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- 172.21.15.28:0/3032830112 wait complete. 2024-09-15T22:56:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 Processor -- start 2024-09-15T22:56:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- start start 2024-09-15T22:56:33.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2800d0190 0x7ff2800b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff280145970 0x7ff280143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800ce980 con 0x7ff2800b24d0 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800ce800 con 0x7ff280145970 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff2854f9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff2800ceb00 con 0x7ff2800d0190 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44186/0 (socket says 172.21.15.28:44186) 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 -- 172.21.15.28:0/1446851530 learned_addr learned my addr 172.21.15.28:0/1446851530 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff277fff640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2800d0190 0x7ff2800b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27f7fe640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff280145970 0x7ff280143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 -- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2800d0190 msgr2=0x7ff2800b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2800d0190 0x7ff2800b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 -- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff280145970 msgr2=0x7ff280143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff280145970 0x7ff280143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.956+0000 7ff27effd640 1 -- 172.21.15.28:0/1446851530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800ccc50 con 0x7ff2800b24d0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff27effd640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c370 tx=0x7ff27000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270017070 con 0x7ff2800b24d0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff270005cf0 con 0x7ff2800b24d0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700072f0 con 0x7ff2800b24d0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff280139ae0 con 0x7ff2800b24d0 2024-09-15T22:56:33.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28013a0a0 con 0x7ff2800b24d0 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2801370b0 con 0x7ff2800b24d0 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff27001a070 con 0x7ff2800b24d0 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 0x7ff260069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff270084f30 con 0x7ff2800b24d0 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff277fff640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 0x7ff260069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.960+0000 7ff277fff640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 0x7ff260069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff2680ad000 tx=0x7ff2680a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:33.964+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2800ccc50 con 0x7ff2800b24d0 2024-09-15T22:56:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.120+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2800cfc20 con 0x7ff2600678f0 2024-09-15T22:56:34.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.132+0000 7ff2777fe640 1 -- 172.21.15.28:0/1446851530 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7ff2800cfc20 con 0x7ff2600678f0 2024-09-15T22:56:34.135 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:34.137 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 msgr2=0x7ff260069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 0x7ff260069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff2680ad000 tx=0x7ff2680a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 msgr2=0x7ff28013bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c370 tx=0x7ff27000c830 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 shutdown_connections 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2600678f0 0x7ff260069db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff280145970 0x7ff280143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2800d0190 0x7ff2800b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 --2- 172.21.15.28:0/1446851530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2800b24d0 0x7ff28013bdb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 >> 172.21.15.28:0/1446851530 conn(0x7ff28006bcc0 msgr2=0x7ff2800b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 shutdown_connections 2024-09-15T22:56:34.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.136+0000 7ff2854f9640 1 -- 172.21.15.28:0/1446851530 wait complete. 2024-09-15T22:56:34.152 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-15T22:56:33.870557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235732,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738988,"statfs":{"total":773094113280,"available":772852723712,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.868094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180547+0000","last_change":"2024-09-15T22:56:21.056451+0000","last_active":"2024-09-15T22:56:23.180547+0000","last_peered":"2024-09-15T22:56:23.180547+0000","last_clean":"2024-09-15T22:56:23.180547+0000","last_became_active":"2024-09-15T22:56:21.056145+0000","last_became_peered":"2024-09-15T22:56:21.056145+0000","last_unstale":"2024-09-15T22:56:23.180547+0000","last_undegraded":"2024-09-15T22:56:23.180547+0000","last_fullsized":"2024-09-15T22:56:23.180547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003947+0000","last_change":"2024-09-15T22:56:21.032126+0000","last_active":"2024-09-15T22:56:22.003947+0000","last_peered":"2024-09-15T22:56:22.003947+0000","last_clean":"2024-09-15T22:56:22.003947+0000","last_became_active":"2024-09-15T22:56:21.031366+0000","last_became_peered":"2024-09-15T22:56:21.031366+0000","last_unstale":"2024-09-15T22:56:22.003947+0000","last_undegraded":"2024-09-15T22:56:22.003947+0000","last_fullsized":"2024-09-15T22:56:22.003947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142427+0000","last_change":"2024-09-15T22:56:21.019102+0000","last_active":"2024-09-15T22:56:22.142427+0000","last_peered":"2024-09-15T22:56:22.142427+0000","last_clean":"2024-09-15T22:56:22.142427+0000","last_became_active":"2024-09-15T22:56:21.018279+0000","last_became_peered":"2024-09-15T22:56:21.018279+0000","last_unstale":"2024-09-15T22:56:22.142427+0000","last_undegraded":"2024-09-15T22:56:22.142427+0000","last_fullsized":"2024-09-15T22:56:22.142427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005366+0000","last_change":"2024-09-15T22:56:21.038401+0000","last_active":"2024-09-15T22:56:22.005366+0000","last_peered":"2024-09-15T22:56:22.005366+0000","last_clean":"2024-09-15T22:56:22.005366+0000","last_became_active":"2024-09-15T22:56:21.037254+0000","last_became_peered":"2024-09-15T22:56:21.037254+0000","last_unstale":"2024-09-15T22:56:22.005366+0000","last_undegraded":"2024-09-15T22:56:22.005366+0000","last_fullsized":"2024-09-15T22:56:22.005366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180159+0000","last_change":"2024-09-15T22:56:21.045620+0000","last_active":"2024-09-15T22:56:23.180159+0000","last_peered":"2024-09-15T22:56:23.180159+0000","last_clean":"2024-09-15T22:56:23.180159+0000","last_became_active":"2024-09-15T22:56:21.044268+0000","last_became_peered":"2024-09-15T22:56:21.044268+0000","last_unstale":"2024-09-15T22:56:23.180159+0000","last_undegraded":"2024-09-15T22:56:23.180159+0000","last_fullsized":"2024-09-15T22:56:23.180159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006657+0000","last_change":"2024-09-15T22:56:21.032910+0000","last_active":"2024-09-15T22:56:22.006657+0000","last_peered":"2024-09-15T22:56:22.006657+0000","last_clean":"2024-09-15T22:56:22.006657+0000","last_became_active":"2024-09-15T22:56:21.032121+0000","last_became_peered":"2024-09-15T22:56:21.032121+0000","last_unstale":"2024-09-15T22:56:22.006657+0000","last_undegraded":"2024-09-15T22:56:22.006657+0000","last_fullsized":"2024-09-15T22:56:22.006657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179615+0000","last_change":"2024-09-15T22:56:21.040858+0000","last_active":"2024-09-15T22:56:23.179615+0000","last_peered":"2024-09-15T22:56:23.179615+0000","last_clean":"2024-09-15T22:56:23.179615+0000","last_became_active":"2024-09-15T22:56:21.040118+0000","last_became_peered":"2024-09-15T22:56:21.040118+0000","last_unstale":"2024-09-15T22:56:23.179615+0000","last_undegraded":"2024-09-15T22:56:23.179615+0000","last_fullsized":"2024-09-15T22:56:23.179615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216724+0000","last_change":"2024-09-15T22:56:21.045328+0000","last_active":"2024-09-15T22:56:22.216724+0000","last_peered":"2024-09-15T22:56:22.216724+0000","last_clean":"2024-09-15T22:56:22.216724+0000","last_became_active":"2024-09-15T22:56:21.041149+0000","last_became_peered":"2024-09-15T22:56:21.041149+0000","last_unstale":"2024-09-15T22:56:22.216724+0000","last_undegraded":"2024-09-15T22:56:22.216724+0000","last_fullsized":"2024-09-15T22:56:22.216724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180976+0000","last_change":"2024-09-15T22:56:21.050262+0000","last_active":"2024-09-15T22:56:23.180976+0000","last_peered":"2024-09-15T22:56:23.180976+0000","last_clean":"2024-09-15T22:56:23.180976+0000","last_became_active":"2024-09-15T22:56:21.049947+0000","last_became_peered":"2024-09-15T22:56:21.049947+0000","last_unstale":"2024-09-15T22:56:23.180976+0000","last_undegraded":"2024-09-15T22:56:23.180976+0000","last_fullsized":"2024-09-15T22:56:23.180976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:10.140812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050907+0000","last_change":"2024-09-15T22:56:21.047268+0000","last_active":"2024-09-15T22:56:22.050907+0000","last_peered":"2024-09-15T22:56:22.050907+0000","last_clean":"2024-09-15T22:56:22.050907+0000","last_became_active":"2024-09-15T22:56:21.037053+0000","last_became_peered":"2024-09-15T22:56:21.037053+0000","last_unstale":"2024-09-15T22:56:22.050907+0000","last_undegraded":"2024-09-15T22:56:22.050907+0000","last_fullsized":"2024-09-15T22:56:22.050907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050656+0000","last_change":"2024-09-15T22:56:21.025979+0000","last_active":"2024-09-15T22:56:22.050656+0000","last_peered":"2024-09-15T22:56:22.050656+0000","last_clean":"2024-09-15T22:56:22.050656+0000","last_became_active":"2024-09-15T22:56:21.025244+0000","last_became_peered":"2024-09-15T22:56:21.025244+0000","last_unstale":"2024-09-15T22:56:22.050656+0000","last_undegraded":"2024-09-15T22:56:22.050656+0000","last_fullsized":"2024-09-15T22:56:22.050656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009445+0000","last_change":"2024-09-15T22:56:21.048891+0000","last_active":"2024-09-15T22:56:22.009445+0000","last_peered":"2024-09-15T22:56:22.009445+0000","last_clean":"2024-09-15T22:56:22.009445+0000","last_became_active":"2024-09-15T22:56:21.047867+0000","last_became_peered":"2024-09-15T22:56:21.047867+0000","last_unstale":"2024-09-15T22:56:22.009445+0000","last_undegraded":"2024-09-15T22:56:22.009445+0000","last_fullsized":"2024-09-15T22:56:22.009445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.606840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217499+0000","last_change":"2024-09-15T22:56:21.040543+0000","last_active":"2024-09-15T22:56:22.217499+0000","last_peered":"2024-09-15T22:56:22.217499+0000","last_clean":"2024-09-15T22:56:22.217499+0000","last_became_active":"2024-09-15T22:56:21.037513+0000","last_became_peered":"2024-09-15T22:56:21.037513+0000","last_unstale":"2024-09-15T22:56:22.217499+0000","last_undegraded":"2024-09-15T22:56:22.217499+0000","last_fullsized":"2024-09-15T22:56:22.217499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141539+0000","last_change":"2024-09-15T22:56:21.030445+0000","last_active":"2024-09-15T22:56:22.141539+0000","last_peered":"2024-09-15T22:56:22.141539+0000","last_clean":"2024-09-15T22:56:22.141539+0000","last_became_active":"2024-09-15T22:56:21.029183+0000","last_became_peered":"2024-09-15T22:56:21.029183+0000","last_unstale":"2024-09-15T22:56:22.141539+0000","last_undegraded":"2024-09-15T22:56:22.141539+0000","last_fullsized":"2024-09-15T22:56:22.141539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:25.498214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003208+0000","last_change":"2024-09-15T22:56:21.060226+0000","last_active":"2024-09-15T22:56:22.003208+0000","last_peered":"2024-09-15T22:56:22.003208+0000","last_clean":"2024-09-15T22:56:22.003208+0000","last_became_active":"2024-09-15T22:56:21.059278+0000","last_became_peered":"2024-09-15T22:56:21.059278+0000","last_unstale":"2024-09-15T22:56:22.003208+0000","last_undegraded":"2024-09-15T22:56:22.003208+0000","last_fullsized":"2024-09-15T22:56:22.003208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005250+0000","last_change":"2024-09-15T22:56:21.031563+0000","last_active":"2024-09-15T22:56:22.005250+0000","last_peered":"2024-09-15T22:56:22.005250+0000","last_clean":"2024-09-15T22:56:22.005250+0000","last_became_active":"2024-09-15T22:56:21.030766+0000","last_became_peered":"2024-09-15T22:56:21.030766+0000","last_unstale":"2024-09-15T22:56:22.005250+0000","last_undegraded":"2024-09-15T22:56:22.005250+0000","last_fullsized":"2024-09-15T22:56:22.005250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006836+0000","last_change":"2024-09-15T22:56:21.027156+0000","last_active":"2024-09-15T22:56:22.006836+0000","last_peered":"2024-09-15T22:56:22.006836+0000","last_clean":"2024-09-15T22:56:22.006836+0000","last_became_active":"2024-09-15T22:56:21.026524+0000","last_became_peered":"2024-09-15T22:56:21.026524+0000","last_unstale":"2024-09-15T22:56:22.006836+0000","last_undegraded":"2024-09-15T22:56:22.006836+0000","last_fullsized":"2024-09-15T22:56:22.006836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179333+0000","last_change":"2024-09-15T22:56:21.026616+0000","last_active":"2024-09-15T22:56:23.179333+0000","last_peered":"2024-09-15T22:56:23.179333+0000","last_clean":"2024-09-15T22:56:23.179333+0000","last_became_active":"2024-09-15T22:56:21.025720+0000","last_became_peered":"2024-09-15T22:56:21.025720+0000","last_unstale":"2024-09-15T22:56:23.179333+0000","last_undegraded":"2024-09-15T22:56:23.179333+0000","last_fullsized":"2024-09-15T22:56:23.179333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180750+0000","last_change":"2024-09-15T22:56:21.050095+0000","last_active":"2024-09-15T22:56:23.180750+0000","last_peered":"2024-09-15T22:56:23.180750+0000","last_clean":"2024-09-15T22:56:23.180750+0000","last_became_active":"2024-09-15T22:56:21.049818+0000","last_became_peered":"2024-09-15T22:56:21.049818+0000","last_unstale":"2024-09-15T22:56:23.180750+0000","last_undegraded":"2024-09-15T22:56:23.180750+0000","last_fullsized":"2024-09-15T22:56:23.180750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:38.202110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051010+0000","last_change":"2024-09-15T22:56:21.060371+0000","last_active":"2024-09-15T22:56:22.051010+0000","last_peered":"2024-09-15T22:56:22.051010+0000","last_clean":"2024-09-15T22:56:22.051010+0000","last_became_active":"2024-09-15T22:56:21.060056+0000","last_became_peered":"2024-09-15T22:56:21.060056+0000","last_unstale":"2024-09-15T22:56:22.051010+0000","last_undegraded":"2024-09-15T22:56:22.051010+0000","last_fullsized":"2024-09-15T22:56:22.051010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141782+0000","last_change":"2024-09-15T22:56:21.032143+0000","last_active":"2024-09-15T22:56:22.141782+0000","last_peered":"2024-09-15T22:56:22.141782+0000","last_clean":"2024-09-15T22:56:22.141782+0000","last_became_active":"2024-09-15T22:56:21.029384+0000","last_became_peered":"2024-09-15T22:56:21.029384+0000","last_unstale":"2024-09-15T22:56:22.141782+0000","last_undegraded":"2024-09-15T22:56:22.141782+0000","last_fullsized":"2024-09-15T22:56:22.141782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006884+0000","last_change":"2024-09-15T22:56:21.033531+0000","last_active":"2024-09-15T22:56:22.006884+0000","last_peered":"2024-09-15T22:56:22.006884+0000","last_clean":"2024-09-15T22:56:22.006884+0000","last_became_active":"2024-09-15T22:56:21.028976+0000","last_became_peered":"2024-09-15T22:56:21.028976+0000","last_unstale":"2024-09-15T22:56:22.006884+0000","last_undegraded":"2024-09-15T22:56:22.006884+0000","last_fullsized":"2024-09-15T22:56:22.006884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216872+0000","last_change":"2024-09-15T22:56:21.062713+0000","last_active":"2024-09-15T22:56:22.216872+0000","last_peered":"2024-09-15T22:56:22.216872+0000","last_clean":"2024-09-15T22:56:22.216872+0000","last_became_active":"2024-09-15T22:56:21.062258+0000","last_became_peered":"2024-09-15T22:56:21.062258+0000","last_unstale":"2024-09-15T22:56:22.216872+0000","last_undegraded":"2024-09-15T22:56:22.216872+0000","last_fullsized":"2024-09-15T22:56:22.216872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005697+0000","last_change":"2024-09-15T22:56:21.036717+0000","last_active":"2024-09-15T22:56:22.005697+0000","last_peered":"2024-09-15T22:56:22.005697+0000","last_clean":"2024-09-15T22:56:22.005697+0000","last_became_active":"2024-09-15T22:56:21.035818+0000","last_became_peered":"2024-09-15T22:56:21.035818+0000","last_unstale":"2024-09-15T22:56:22.005697+0000","last_undegraded":"2024-09-15T22:56:22.005697+0000","last_fullsized":"2024-09-15T22:56:22.005697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218073+0000","last_change":"2024-09-15T22:56:21.050243+0000","last_active":"2024-09-15T22:56:22.218073+0000","last_peered":"2024-09-15T22:56:22.218073+0000","last_clean":"2024-09-15T22:56:22.218073+0000","last_became_active":"2024-09-15T22:56:21.049811+0000","last_became_peered":"2024-09-15T22:56:21.049811+0000","last_unstale":"2024-09-15T22:56:22.218073+0000","last_undegraded":"2024-09-15T22:56:22.218073+0000","last_fullsized":"2024-09-15T22:56:22.218073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.051051+0000","last_change":"2024-09-15T22:56:21.034983+0000","last_active":"2024-09-15T22:56:22.051051+0000","last_peered":"2024-09-15T22:56:22.051051+0000","last_clean":"2024-09-15T22:56:22.051051+0000","last_became_active":"2024-09-15T22:56:21.034274+0000","last_became_peered":"2024-09-15T22:56:21.034274+0000","last_unstale":"2024-09-15T22:56:22.051051+0000","last_undegraded":"2024-09-15T22:56:22.051051+0000","last_fullsized":"2024-09-15T22:56:22.051051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003271+0000","last_change":"2024-09-15T22:56:21.039395+0000","last_active":"2024-09-15T22:56:22.003271+0000","last_peered":"2024-09-15T22:56:22.003271+0000","last_clean":"2024-09-15T22:56:22.003271+0000","last_became_active":"2024-09-15T22:56:21.039113+0000","last_became_peered":"2024-09-15T22:56:21.039113+0000","last_unstale":"2024-09-15T22:56:22.003271+0000","last_undegraded":"2024-09-15T22:56:22.003271+0000","last_fullsized":"2024-09-15T22:56:22.003271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217763+0000","last_change":"2024-09-15T22:56:21.062629+0000","last_active":"2024-09-15T22:56:22.217763+0000","last_peered":"2024-09-15T22:56:22.217763+0000","last_clean":"2024-09-15T22:56:22.217763+0000","last_became_active":"2024-09-15T22:56:21.062301+0000","last_became_peered":"2024-09-15T22:56:21.062301+0000","last_unstale":"2024-09-15T22:56:22.217763+0000","last_undegraded":"2024-09-15T22:56:22.217763+0000","last_fullsized":"2024-09-15T22:56:22.217763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142003+0000","last_change":"2024-09-15T22:56:21.036927+0000","last_active":"2024-09-15T22:56:22.142003+0000","last_peered":"2024-09-15T22:56:22.142003+0000","last_clean":"2024-09-15T22:56:22.142003+0000","last_became_active":"2024-09-15T22:56:21.036612+0000","last_became_peered":"2024-09-15T22:56:21.036612+0000","last_unstale":"2024-09-15T22:56:22.142003+0000","last_undegraded":"2024-09-15T22:56:22.142003+0000","last_fullsized":"2024-09-15T22:56:22.142003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007140+0000","last_change":"2024-09-15T22:56:21.039825+0000","last_active":"2024-09-15T22:56:22.007140+0000","last_peered":"2024-09-15T22:56:22.007140+0000","last_clean":"2024-09-15T22:56:22.007140+0000","last_became_active":"2024-09-15T22:56:21.038388+0000","last_became_peered":"2024-09-15T22:56:21.038388+0000","last_unstale":"2024-09-15T22:56:22.007140+0000","last_undegraded":"2024-09-15T22:56:22.007140+0000","last_fullsized":"2024-09-15T22:56:22.007140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:09.680363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179235+0000","last_change":"2024-09-15T22:56:21.018597+0000","last_active":"2024-09-15T22:56:23.179235+0000","last_peered":"2024-09-15T22:56:23.179235+0000","last_clean":"2024-09-15T22:56:23.179235+0000","last_became_active":"2024-09-15T22:56:21.017870+0000","last_became_peered":"2024-09-15T22:56:21.017870+0000","last_unstale":"2024-09-15T22:56:23.179235+0000","last_undegraded":"2024-09-15T22:56:23.179235+0000","last_fullsized":"2024-09-15T22:56:23.179235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050354+0000","last_change":"2024-09-15T22:56:21.035519+0000","last_active":"2024-09-15T22:56:22.050354+0000","last_peered":"2024-09-15T22:56:22.050354+0000","last_clean":"2024-09-15T22:56:22.050354+0000","last_became_active":"2024-09-15T22:56:21.033628+0000","last_became_peered":"2024-09-15T22:56:21.033628+0000","last_unstale":"2024-09-15T22:56:22.050354+0000","last_undegraded":"2024-09-15T22:56:22.050354+0000","last_fullsized":"2024-09-15T22:56:22.050354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008297+0000","last_change":"2024-09-15T22:56:21.042927+0000","last_active":"2024-09-15T22:56:22.008297+0000","last_peered":"2024-09-15T22:56:22.008297+0000","last_clean":"2024-09-15T22:56:22.008297+0000","last_became_active":"2024-09-15T22:56:21.042371+0000","last_became_peered":"2024-09-15T22:56:21.042371+0000","last_unstale":"2024-09-15T22:56:22.008297+0000","last_undegraded":"2024-09-15T22:56:22.008297+0000","last_fullsized":"2024-09-15T22:56:22.008297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:47.722424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217741+0000","last_change":"2024-09-15T22:56:20.019743+0000","last_active":"2024-09-15T22:56:22.217741+0000","last_peered":"2024-09-15T22:56:22.217741+0000","last_clean":"2024-09-15T22:56:22.217741+0000","last_became_active":"2024-09-15T22:56:20.019261+0000","last_became_peered":"2024-09-15T22:56:20.019261+0000","last_unstale":"2024-09-15T22:56:22.217741+0000","last_undegraded":"2024-09-15T22:56:22.217741+0000","last_fullsized":"2024-09-15T22:56:22.217741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142010+0000","last_change":"2024-09-15T22:56:21.051815+0000","last_active":"2024-09-15T22:56:22.142010+0000","last_peered":"2024-09-15T22:56:22.142010+0000","last_clean":"2024-09-15T22:56:22.142010+0000","last_became_active":"2024-09-15T22:56:21.051533+0000","last_became_peered":"2024-09-15T22:56:21.051533+0000","last_unstale":"2024-09-15T22:56:22.142010+0000","last_undegraded":"2024-09-15T22:56:22.142010+0000","last_fullsized":"2024-09-15T22:56:22.142010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050312+0000","last_change":"2024-09-15T22:56:20.022892+0000","last_active":"2024-09-15T22:56:22.050312+0000","last_peered":"2024-09-15T22:56:22.050312+0000","last_clean":"2024-09-15T22:56:22.050312+0000","last_became_active":"2024-09-15T22:56:20.020964+0000","last_became_peered":"2024-09-15T22:56:20.020964+0000","last_unstale":"2024-09-15T22:56:22.050312+0000","last_undegraded":"2024-09-15T22:56:22.050312+0000","last_fullsized":"2024-09-15T22:56:22.050312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217152+0000","last_change":"2024-09-15T22:56:20.025794+0000","last_active":"2024-09-15T22:56:22.217152+0000","last_peered":"2024-09-15T22:56:22.217152+0000","last_clean":"2024-09-15T22:56:22.217152+0000","last_became_active":"2024-09-15T22:56:20.025491+0000","last_became_peered":"2024-09-15T22:56:20.025491+0000","last_unstale":"2024-09-15T22:56:22.217152+0000","last_undegraded":"2024-09-15T22:56:22.217152+0000","last_fullsized":"2024-09-15T22:56:22.217152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.216948+0000","last_change":"2024-09-15T22:56:21.037092+0000","last_active":"2024-09-15T22:56:22.216948+0000","last_peered":"2024-09-15T22:56:22.216948+0000","last_clean":"2024-09-15T22:56:22.216948+0000","last_became_active":"2024-09-15T22:56:21.036262+0000","last_became_peered":"2024-09-15T22:56:21.036262+0000","last_unstale":"2024-09-15T22:56:22.216948+0000","last_undegraded":"2024-09-15T22:56:22.216948+0000","last_fullsized":"2024-09-15T22:56:22.216948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005951+0000","last_change":"2024-09-15T22:56:20.003804+0000","last_active":"2024-09-15T22:56:22.005951+0000","last_peered":"2024-09-15T22:56:22.005951+0000","last_clean":"2024-09-15T22:56:22.005951+0000","last_became_active":"2024-09-15T22:56:20.000781+0000","last_became_peered":"2024-09-15T22:56:20.000781+0000","last_unstale":"2024-09-15T22:56:22.005951+0000","last_undegraded":"2024-09-15T22:56:22.005951+0000","last_fullsized":"2024-09-15T22:56:22.005951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003006+0000","last_change":"2024-09-15T22:56:21.038747+0000","last_active":"2024-09-15T22:56:22.003006+0000","last_peered":"2024-09-15T22:56:22.003006+0000","last_clean":"2024-09-15T22:56:22.003006+0000","last_became_active":"2024-09-15T22:56:21.038452+0000","last_became_peered":"2024-09-15T22:56:21.038452+0000","last_unstale":"2024-09-15T22:56:22.003006+0000","last_undegraded":"2024-09-15T22:56:22.003006+0000","last_fullsized":"2024-09-15T22:56:22.003006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050686+0000","last_change":"2024-09-15T22:56:20.022079+0000","last_active":"2024-09-15T22:56:22.050686+0000","last_peered":"2024-09-15T22:56:22.050686+0000","last_clean":"2024-09-15T22:56:22.050686+0000","last_became_active":"2024-09-15T22:56:20.021680+0000","last_became_peered":"2024-09-15T22:56:20.021680+0000","last_unstale":"2024-09-15T22:56:22.050686+0000","last_undegraded":"2024-09-15T22:56:22.050686+0000","last_fullsized":"2024-09-15T22:56:22.050686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005757+0000","last_change":"2024-09-15T22:56:21.025007+0000","last_active":"2024-09-15T22:56:22.005757+0000","last_peered":"2024-09-15T22:56:22.005757+0000","last_clean":"2024-09-15T22:56:22.005757+0000","last_became_active":"2024-09-15T22:56:21.023970+0000","last_became_peered":"2024-09-15T22:56:21.023970+0000","last_unstale":"2024-09-15T22:56:22.005757+0000","last_undegraded":"2024-09-15T22:56:22.005757+0000","last_fullsized":"2024-09-15T22:56:22.005757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005763+0000","last_change":"2024-09-15T22:56:20.024712+0000","last_active":"2024-09-15T22:56:22.005763+0000","last_peered":"2024-09-15T22:56:22.005763+0000","last_clean":"2024-09-15T22:56:22.005763+0000","last_became_active":"2024-09-15T22:56:20.024032+0000","last_became_peered":"2024-09-15T22:56:20.024032+0000","last_unstale":"2024-09-15T22:56:22.005763+0000","last_undegraded":"2024-09-15T22:56:22.005763+0000","last_fullsized":"2024-09-15T22:56:22.005763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142513+0000","last_change":"2024-09-15T22:56:21.029548+0000","last_active":"2024-09-15T22:56:22.142513+0000","last_peered":"2024-09-15T22:56:22.142513+0000","last_clean":"2024-09-15T22:56:22.142513+0000","last_became_active":"2024-09-15T22:56:21.028802+0000","last_became_peered":"2024-09-15T22:56:21.028802+0000","last_unstale":"2024-09-15T22:56:22.142513+0000","last_undegraded":"2024-09-15T22:56:22.142513+0000","last_fullsized":"2024-09-15T22:56:22.142513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:15.828454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003341+0000","last_change":"2024-09-15T22:56:20.015843+0000","last_active":"2024-09-15T22:56:22.003341+0000","last_peered":"2024-09-15T22:56:22.003341+0000","last_clean":"2024-09-15T22:56:22.003341+0000","last_became_active":"2024-09-15T22:56:20.015581+0000","last_became_peered":"2024-09-15T22:56:20.015581+0000","last_unstale":"2024-09-15T22:56:22.003341+0000","last_undegraded":"2024-09-15T22:56:22.003341+0000","last_fullsized":"2024-09-15T22:56:22.003341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009002+0000","last_change":"2024-09-15T22:56:21.055834+0000","last_active":"2024-09-15T22:56:22.009002+0000","last_peered":"2024-09-15T22:56:22.009002+0000","last_clean":"2024-09-15T22:56:22.009002+0000","last_became_active":"2024-09-15T22:56:21.049855+0000","last_became_peered":"2024-09-15T22:56:21.049855+0000","last_unstale":"2024-09-15T22:56:22.009002+0000","last_undegraded":"2024-09-15T22:56:22.009002+0000","last_fullsized":"2024-09-15T22:56:22.009002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:11.763410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050975+0000","last_change":"2024-09-15T22:56:20.023384+0000","last_active":"2024-09-15T22:56:22.050975+0000","last_peered":"2024-09-15T22:56:22.050975+0000","last_clean":"2024-09-15T22:56:22.050975+0000","last_became_active":"2024-09-15T22:56:20.020942+0000","last_became_peered":"2024-09-15T22:56:20.020942+0000","last_unstale":"2024-09-15T22:56:22.050975+0000","last_undegraded":"2024-09-15T22:56:22.050975+0000","last_fullsized":"2024-09-15T22:56:22.050975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180006+0000","last_change":"2024-09-15T22:56:21.046560+0000","last_active":"2024-09-15T22:56:23.180006+0000","last_peered":"2024-09-15T22:56:23.180006+0000","last_clean":"2024-09-15T22:56:23.180006+0000","last_became_active":"2024-09-15T22:56:21.045861+0000","last_became_peered":"2024-09-15T22:56:21.045861+0000","last_unstale":"2024-09-15T22:56:23.180006+0000","last_undegraded":"2024-09-15T22:56:23.180006+0000","last_fullsized":"2024-09-15T22:56:23.180006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:21.197957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142150+0000","last_change":"2024-09-15T22:56:20.011235+0000","last_active":"2024-09-15T22:56:22.142150+0000","last_peered":"2024-09-15T22:56:22.142150+0000","last_clean":"2024-09-15T22:56:22.142150+0000","last_became_active":"2024-09-15T22:56:20.010877+0000","last_became_peered":"2024-09-15T22:56:20.010877+0000","last_unstale":"2024-09-15T22:56:22.142150+0000","last_undegraded":"2024-09-15T22:56:22.142150+0000","last_fullsized":"2024-09-15T22:56:22.142150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141682+0000","last_change":"2024-09-15T22:56:21.030324+0000","last_active":"2024-09-15T22:56:22.141682+0000","last_peered":"2024-09-15T22:56:22.141682+0000","last_clean":"2024-09-15T22:56:22.141682+0000","last_became_active":"2024-09-15T22:56:21.029364+0000","last_became_peered":"2024-09-15T22:56:21.029364+0000","last_unstale":"2024-09-15T22:56:22.141682+0000","last_undegraded":"2024-09-15T22:56:22.141682+0000","last_fullsized":"2024-09-15T22:56:22.141682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007313+0000","last_change":"2024-09-15T22:56:20.009686+0000","last_active":"2024-09-15T22:56:22.007313+0000","last_peered":"2024-09-15T22:56:22.007313+0000","last_clean":"2024-09-15T22:56:22.007313+0000","last_became_active":"2024-09-15T22:56:20.007369+0000","last_became_peered":"2024-09-15T22:56:20.007369+0000","last_unstale":"2024-09-15T22:56:22.007313+0000","last_undegraded":"2024-09-15T22:56:22.007313+0000","last_fullsized":"2024-09-15T22:56:22.007313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180348+0000","last_change":"2024-09-15T22:56:21.059175+0000","last_active":"2024-09-15T22:56:23.180348+0000","last_peered":"2024-09-15T22:56:23.180348+0000","last_clean":"2024-09-15T22:56:23.180348+0000","last_became_active":"2024-09-15T22:56:21.058849+0000","last_became_peered":"2024-09-15T22:56:21.058849+0000","last_unstale":"2024-09-15T22:56:23.180348+0000","last_undegraded":"2024-09-15T22:56:23.180348+0000","last_fullsized":"2024-09-15T22:56:23.180348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:55.597695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050178+0000","last_change":"2024-09-15T22:56:20.022582+0000","last_active":"2024-09-15T22:56:22.050178+0000","last_peered":"2024-09-15T22:56:22.050178+0000","last_clean":"2024-09-15T22:56:22.050178+0000","last_became_active":"2024-09-15T22:56:20.021858+0000","last_became_peered":"2024-09-15T22:56:20.021858+0000","last_unstale":"2024-09-15T22:56:22.050178+0000","last_undegraded":"2024-09-15T22:56:22.050178+0000","last_fullsized":"2024-09-15T22:56:22.050178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050382+0000","last_change":"2024-09-15T22:56:21.034329+0000","last_active":"2024-09-15T22:56:22.050382+0000","last_peered":"2024-09-15T22:56:22.050382+0000","last_clean":"2024-09-15T22:56:22.050382+0000","last_became_active":"2024-09-15T22:56:21.032155+0000","last_became_peered":"2024-09-15T22:56:21.032155+0000","last_unstale":"2024-09-15T22:56:22.050382+0000","last_undegraded":"2024-09-15T22:56:22.050382+0000","last_fullsized":"2024-09-15T22:56:22.050382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:14.913598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179149+0000","last_change":"2024-09-15T22:56:19.992629+0000","last_active":"2024-09-15T22:56:23.179149+0000","last_peered":"2024-09-15T22:56:23.179149+0000","last_clean":"2024-09-15T22:56:23.179149+0000","last_became_active":"2024-09-15T22:56:19.992047+0000","last_became_peered":"2024-09-15T22:56:19.992047+0000","last_unstale":"2024-09-15T22:56:23.179149+0000","last_undegraded":"2024-09-15T22:56:23.179149+0000","last_fullsized":"2024-09-15T22:56:23.179149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179693+0000","last_change":"2024-09-15T22:56:21.060727+0000","last_active":"2024-09-15T22:56:23.179693+0000","last_peered":"2024-09-15T22:56:23.179693+0000","last_clean":"2024-09-15T22:56:23.179693+0000","last_became_active":"2024-09-15T22:56:21.060316+0000","last_became_peered":"2024-09-15T22:56:21.060316+0000","last_unstale":"2024-09-15T22:56:23.179693+0000","last_undegraded":"2024-09-15T22:56:23.179693+0000","last_fullsized":"2024-09-15T22:56:23.179693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.009262+0000","last_change":"2024-09-15T22:56:20.010339+0000","last_active":"2024-09-15T22:56:22.009262+0000","last_peered":"2024-09-15T22:56:22.009262+0000","last_clean":"2024-09-15T22:56:22.009262+0000","last_became_active":"2024-09-15T22:56:20.009588+0000","last_became_peered":"2024-09-15T22:56:20.009588+0000","last_unstale":"2024-09-15T22:56:22.009262+0000","last_undegraded":"2024-09-15T22:56:22.009262+0000","last_fullsized":"2024-09-15T22:56:22.009262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:23.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180646+0000","last_change":"2024-09-15T22:56:21.061277+0000","last_active":"2024-09-15T22:56:23.180646+0000","last_peered":"2024-09-15T22:56:23.180646+0000","last_clean":"2024-09-15T22:56:23.180646+0000","last_became_active":"2024-09-15T22:56:21.061012+0000","last_became_peered":"2024-09-15T22:56:21.061012+0000","last_unstale":"2024-09-15T22:56:23.180646+0000","last_undegraded":"2024-09-15T22:56:23.180646+0000","last_fullsized":"2024-09-15T22:56:23.180646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.747289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179357+0000","last_change":"2024-09-15T22:56:20.009833+0000","last_active":"2024-09-15T22:56:23.179357+0000","last_peered":"2024-09-15T22:56:23.179357+0000","last_clean":"2024-09-15T22:56:23.179357+0000","last_became_active":"2024-09-15T22:56:20.009456+0000","last_became_peered":"2024-09-15T22:56:20.009456+0000","last_unstale":"2024-09-15T22:56:23.179357+0000","last_undegraded":"2024-09-15T22:56:23.179357+0000","last_fullsized":"2024-09-15T22:56:23.179357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.181081+0000","last_change":"2024-09-15T22:56:21.061243+0000","last_active":"2024-09-15T22:56:23.181081+0000","last_peered":"2024-09-15T22:56:23.181081+0000","last_clean":"2024-09-15T22:56:23.181081+0000","last_became_active":"2024-09-15T22:56:21.060909+0000","last_became_peered":"2024-09-15T22:56:21.060909+0000","last_unstale":"2024-09-15T22:56:23.181081+0000","last_undegraded":"2024-09-15T22:56:23.181081+0000","last_fullsized":"2024-09-15T22:56:23.181081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:42.598011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003379+0000","last_change":"2024-09-15T22:56:20.004397+0000","last_active":"2024-09-15T22:56:22.003379+0000","last_peered":"2024-09-15T22:56:22.003379+0000","last_clean":"2024-09-15T22:56:22.003379+0000","last_became_active":"2024-09-15T22:56:20.003956+0000","last_became_peered":"2024-09-15T22:56:20.003956+0000","last_unstale":"2024-09-15T22:56:22.003379+0000","last_undegraded":"2024-09-15T22:56:22.003379+0000","last_fullsized":"2024-09-15T22:56:22.003379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.094041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005819+0000","last_change":"2024-09-15T22:56:21.037223+0000","last_active":"2024-09-15T22:56:22.005819+0000","last_peered":"2024-09-15T22:56:22.005819+0000","last_clean":"2024-09-15T22:56:22.005819+0000","last_became_active":"2024-09-15T22:56:21.036206+0000","last_became_peered":"2024-09-15T22:56:21.036206+0000","last_unstale":"2024-09-15T22:56:22.005819+0000","last_undegraded":"2024-09-15T22:56:22.005819+0000","last_fullsized":"2024-09-15T22:56:22.005819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:18.911378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179520+0000","last_change":"2024-09-15T22:56:20.005837+0000","last_active":"2024-09-15T22:56:23.179520+0000","last_peered":"2024-09-15T22:56:23.179520+0000","last_clean":"2024-09-15T22:56:23.179520+0000","last_became_active":"2024-09-15T22:56:20.005441+0000","last_became_peered":"2024-09-15T22:56:20.005441+0000","last_unstale":"2024-09-15T22:56:23.179520+0000","last_undegraded":"2024-09-15T22:56:23.179520+0000","last_fullsized":"2024-09-15T22:56:23.179520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180199+0000","last_change":"2024-09-15T22:56:21.046827+0000","last_active":"2024-09-15T22:56:23.180199+0000","last_peered":"2024-09-15T22:56:23.180199+0000","last_clean":"2024-09-15T22:56:23.180199+0000","last_became_active":"2024-09-15T22:56:21.046257+0000","last_became_peered":"2024-09-15T22:56:21.046257+0000","last_unstale":"2024-09-15T22:56:23.180199+0000","last_undegraded":"2024-09-15T22:56:23.180199+0000","last_fullsized":"2024-09-15T22:56:23.180199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:15.902592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179789+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:56:23.179789+0000","last_peered":"2024-09-15T22:56:23.179789+0000","last_clean":"2024-09-15T22:56:23.179789+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:56:23.179789+0000","last_undegraded":"2024-09-15T22:56:23.179789+0000","last_fullsized":"2024-09-15T22:56:23.179789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005089+0000","last_change":"2024-09-15T22:56:20.008235+0000","last_active":"2024-09-15T22:56:22.005089+0000","last_peered":"2024-09-15T22:56:22.005089+0000","last_clean":"2024-09-15T22:56:22.005089+0000","last_became_active":"2024-09-15T22:56:19.996140+0000","last_became_peered":"2024-09-15T22:56:19.996140+0000","last_unstale":"2024-09-15T22:56:22.005089+0000","last_undegraded":"2024-09-15T22:56:22.005089+0000","last_fullsized":"2024-09-15T22:56:22.005089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217092+0000","last_change":"2024-09-15T22:56:21.037507+0000","last_active":"2024-09-15T22:56:22.217092+0000","last_peered":"2024-09-15T22:56:22.217092+0000","last_clean":"2024-09-15T22:56:22.217092+0000","last_became_active":"2024-09-15T22:56:21.036694+0000","last_became_peered":"2024-09-15T22:56:21.036694+0000","last_unstale":"2024-09-15T22:56:22.217092+0000","last_undegraded":"2024-09-15T22:56:22.217092+0000","last_fullsized":"2024-09-15T22:56:22.217092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:05.231130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179425+0000","last_change":"2024-09-15T22:56:20.026404+0000","last_active":"2024-09-15T22:56:23.179425+0000","last_peered":"2024-09-15T22:56:23.179425+0000","last_clean":"2024-09-15T22:56:23.179425+0000","last_became_active":"2024-09-15T22:56:20.025643+0000","last_became_peered":"2024-09-15T22:56:20.025643+0000","last_unstale":"2024-09-15T22:56:23.179425+0000","last_undegraded":"2024-09-15T22:56:23.179425+0000","last_fullsized":"2024-09-15T22:56:23.179425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.141425+0000","last_change":"2024-09-15T22:56:21.059613+0000","last_active":"2024-09-15T22:56:22.141425+0000","last_peered":"2024-09-15T22:56:22.141425+0000","last_clean":"2024-09-15T22:56:22.141425+0000","last_became_active":"2024-09-15T22:56:21.059232+0000","last_became_peered":"2024-09-15T22:56:21.059232+0000","last_unstale":"2024-09-15T22:56:22.141425+0000","last_undegraded":"2024-09-15T22:56:22.141425+0000","last_fullsized":"2024-09-15T22:56:22.141425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:27.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179315+0000","last_change":"2024-09-15T22:56:20.004055+0000","last_active":"2024-09-15T22:56:23.179315+0000","last_peered":"2024-09-15T22:56:23.179315+0000","last_clean":"2024-09-15T22:56:23.179315+0000","last_became_active":"2024-09-15T22:56:20.003360+0000","last_became_peered":"2024-09-15T22:56:20.003360+0000","last_unstale":"2024-09-15T22:56:23.179315+0000","last_undegraded":"2024-09-15T22:56:23.179315+0000","last_fullsized":"2024-09-15T22:56:23.179315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:35.813656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003288+0000","last_change":"2024-09-15T22:56:21.025917+0000","last_active":"2024-09-15T22:56:22.003288+0000","last_peered":"2024-09-15T22:56:22.003288+0000","last_clean":"2024-09-15T22:56:22.003288+0000","last_became_active":"2024-09-15T22:56:21.024942+0000","last_became_peered":"2024-09-15T22:56:21.024942+0000","last_unstale":"2024-09-15T22:56:22.003288+0000","last_undegraded":"2024-09-15T22:56:22.003288+0000","last_fullsized":"2024-09-15T22:56:22.003288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:28.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.007443+0000","last_change":"2024-09-15T22:56:20.005070+0000","last_active":"2024-09-15T22:56:22.007443+0000","last_peered":"2024-09-15T22:56:22.007443+0000","last_clean":"2024-09-15T22:56:22.007443+0000","last_became_active":"2024-09-15T22:56:20.004285+0000","last_became_peered":"2024-09-15T22:56:20.004285+0000","last_unstale":"2024-09-15T22:56:22.007443+0000","last_undegraded":"2024-09-15T22:56:22.007443+0000","last_fullsized":"2024-09-15T22:56:22.007443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008636+0000","last_change":"2024-09-15T22:56:21.048376+0000","last_active":"2024-09-15T22:56:22.008636+0000","last_peered":"2024-09-15T22:56:22.008636+0000","last_clean":"2024-09-15T22:56:22.008636+0000","last_became_active":"2024-09-15T22:56:21.044757+0000","last_became_peered":"2024-09-15T22:56:21.044757+0000","last_unstale":"2024-09-15T22:56:22.008636+0000","last_undegraded":"2024-09-15T22:56:22.008636+0000","last_fullsized":"2024-09-15T22:56:22.008636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:47.536126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004374+0000","last_change":"2024-09-15T22:56:20.009327+0000","last_active":"2024-09-15T22:56:22.004374+0000","last_peered":"2024-09-15T22:56:22.004374+0000","last_clean":"2024-09-15T22:56:22.004374+0000","last_became_active":"2024-09-15T22:56:20.008844+0000","last_became_peered":"2024-09-15T22:56:20.008844+0000","last_unstale":"2024-09-15T22:56:22.004374+0000","last_undegraded":"2024-09-15T22:56:22.004374+0000","last_fullsized":"2024-09-15T22:56:22.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:37.674889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006284+0000","last_change":"2024-09-15T22:56:21.037003+0000","last_active":"2024-09-15T22:56:22.006284+0000","last_peered":"2024-09-15T22:56:22.006284+0000","last_clean":"2024-09-15T22:56:22.006284+0000","last_became_active":"2024-09-15T22:56:21.036088+0000","last_became_peered":"2024-09-15T22:56:21.036088+0000","last_unstale":"2024-09-15T22:56:22.006284+0000","last_undegraded":"2024-09-15T22:56:22.006284+0000","last_fullsized":"2024-09-15T22:56:22.006284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:50.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180792+0000","last_change":"2024-09-15T22:56:20.026706+0000","last_active":"2024-09-15T22:56:23.180792+0000","last_peered":"2024-09-15T22:56:23.180792+0000","last_clean":"2024-09-15T22:56:23.180792+0000","last_became_active":"2024-09-15T22:56:20.026077+0000","last_became_peered":"2024-09-15T22:56:20.026077+0000","last_unstale":"2024-09-15T22:56:23.180792+0000","last_undegraded":"2024-09-15T22:56:23.180792+0000","last_fullsized":"2024-09-15T22:56:23.180792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:51.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004381+0000","last_change":"2024-09-15T22:56:21.027999+0000","last_active":"2024-09-15T22:56:22.004381+0000","last_peered":"2024-09-15T22:56:22.004381+0000","last_clean":"2024-09-15T22:56:22.004381+0000","last_became_active":"2024-09-15T22:56:21.027045+0000","last_became_peered":"2024-09-15T22:56:21.027045+0000","last_unstale":"2024-09-15T22:56:22.004381+0000","last_undegraded":"2024-09-15T22:56:22.004381+0000","last_fullsized":"2024-09-15T22:56:22.004381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.004145+0000","last_change":"2024-09-15T22:56:20.024892+0000","last_active":"2024-09-15T22:56:22.004145+0000","last_peered":"2024-09-15T22:56:22.004145+0000","last_clean":"2024-09-15T22:56:22.004145+0000","last_became_active":"2024-09-15T22:56:20.024581+0000","last_became_peered":"2024-09-15T22:56:20.024581+0000","last_unstale":"2024-09-15T22:56:22.004145+0000","last_undegraded":"2024-09-15T22:56:22.004145+0000","last_fullsized":"2024-09-15T22:56:22.004145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:03.135259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218282+0000","last_change":"2024-09-15T22:56:21.047660+0000","last_active":"2024-09-15T22:56:22.218282+0000","last_peered":"2024-09-15T22:56:22.218282+0000","last_clean":"2024-09-15T22:56:22.218282+0000","last_became_active":"2024-09-15T22:56:21.046792+0000","last_became_peered":"2024-09-15T22:56:21.046792+0000","last_unstale":"2024-09-15T22:56:22.218282+0000","last_undegraded":"2024-09-15T22:56:22.218282+0000","last_fullsized":"2024-09-15T22:56:22.218282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050772+0000","last_change":"2024-09-15T22:56:20.023298+0000","last_active":"2024-09-15T22:56:22.050772+0000","last_peered":"2024-09-15T22:56:22.050772+0000","last_clean":"2024-09-15T22:56:22.050772+0000","last_became_active":"2024-09-15T22:56:20.022655+0000","last_became_peered":"2024-09-15T22:56:20.022655+0000","last_unstale":"2024-09-15T22:56:22.050772+0000","last_undegraded":"2024-09-15T22:56:22.050772+0000","last_fullsized":"2024-09-15T22:56:22.050772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142574+0000","last_change":"2024-09-15T22:56:21.023902+0000","last_active":"2024-09-15T22:56:22.142574+0000","last_peered":"2024-09-15T22:56:22.142574+0000","last_clean":"2024-09-15T22:56:22.142574+0000","last_became_active":"2024-09-15T22:56:21.022501+0000","last_became_peered":"2024-09-15T22:56:21.022501+0000","last_unstale":"2024-09-15T22:56:22.142574+0000","last_undegraded":"2024-09-15T22:56:22.142574+0000","last_fullsized":"2024-09-15T22:56:22.142574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.179422+0000","last_change":"2024-09-15T22:56:20.025880+0000","last_active":"2024-09-15T22:56:23.179422+0000","last_peered":"2024-09-15T22:56:23.179422+0000","last_clean":"2024-09-15T22:56:23.179422+0000","last_became_active":"2024-09-15T22:56:20.024972+0000","last_became_peered":"2024-09-15T22:56:20.024972+0000","last_unstale":"2024-09-15T22:56:23.179422+0000","last_undegraded":"2024-09-15T22:56:23.179422+0000","last_fullsized":"2024-09-15T22:56:23.179422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:46.712577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.008423+0000","last_change":"2024-09-15T22:56:21.057092+0000","last_active":"2024-09-15T22:56:22.008423+0000","last_peered":"2024-09-15T22:56:22.008423+0000","last_clean":"2024-09-15T22:56:22.008423+0000","last_became_active":"2024-09-15T22:56:21.044676+0000","last_became_peered":"2024-09-15T22:56:21.044676+0000","last_unstale":"2024-09-15T22:56:22.008423+0000","last_undegraded":"2024-09-15T22:56:22.008423+0000","last_fullsized":"2024-09-15T22:56:22.008423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:04.145107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003472+0000","last_change":"2024-09-15T22:56:20.017700+0000","last_active":"2024-09-15T22:56:22.003472+0000","last_peered":"2024-09-15T22:56:22.003472+0000","last_clean":"2024-09-15T22:56:22.003472+0000","last_became_active":"2024-09-15T22:56:20.017328+0000","last_became_peered":"2024-09-15T22:56:20.017328+0000","last_unstale":"2024-09-15T22:56:22.003472+0000","last_undegraded":"2024-09-15T22:56:22.003472+0000","last_fullsized":"2024-09-15T22:56:22.003472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:07.185688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217176+0000","last_change":"2024-09-15T22:56:21.035548+0000","last_active":"2024-09-15T22:56:22.217176+0000","last_peered":"2024-09-15T22:56:22.217176+0000","last_clean":"2024-09-15T22:56:22.217176+0000","last_became_active":"2024-09-15T22:56:21.030034+0000","last_became_peered":"2024-09-15T22:56:21.030034+0000","last_unstale":"2024-09-15T22:56:22.217176+0000","last_undegraded":"2024-09-15T22:56:22.217176+0000","last_fullsized":"2024-09-15T22:56:22.217176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:41.757164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.003541+0000","last_change":"2024-09-15T22:56:20.004461+0000","last_active":"2024-09-15T22:56:22.003541+0000","last_peered":"2024-09-15T22:56:22.003541+0000","last_clean":"2024-09-15T22:56:22.003541+0000","last_became_active":"2024-09-15T22:56:20.003751+0000","last_became_peered":"2024-09-15T22:56:20.003751+0000","last_unstale":"2024-09-15T22:56:22.003541+0000","last_undegraded":"2024-09-15T22:56:22.003541+0000","last_fullsized":"2024-09-15T22:56:22.003541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217560+0000","last_change":"2024-09-15T22:56:21.036761+0000","last_active":"2024-09-15T22:56:22.217560+0000","last_peered":"2024-09-15T22:56:22.217560+0000","last_clean":"2024-09-15T22:56:22.217560+0000","last_became_active":"2024-09-15T22:56:21.036060+0000","last_became_peered":"2024-09-15T22:56:21.036060+0000","last_unstale":"2024-09-15T22:56:22.217560+0000","last_undegraded":"2024-09-15T22:56:22.217560+0000","last_fullsized":"2024-09-15T22:56:22.217560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180453+0000","last_change":"2024-09-15T22:56:20.027081+0000","last_active":"2024-09-15T22:56:23.180453+0000","last_peered":"2024-09-15T22:56:23.180453+0000","last_clean":"2024-09-15T22:56:23.180453+0000","last_became_active":"2024-09-15T22:56:20.026469+0000","last_became_peered":"2024-09-15T22:56:20.026469+0000","last_unstale":"2024-09-15T22:56:23.180453+0000","last_undegraded":"2024-09-15T22:56:23.180453+0000","last_fullsized":"2024-09-15T22:56:23.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:46.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.050392+0000","last_change":"2024-09-15T22:56:21.049096+0000","last_active":"2024-09-15T22:56:22.050392+0000","last_peered":"2024-09-15T22:56:22.050392+0000","last_clean":"2024-09-15T22:56:22.050392+0000","last_became_active":"2024-09-15T22:56:21.048786+0000","last_became_peered":"2024-09-15T22:56:21.048786+0000","last_unstale":"2024-09-15T22:56:22.050392+0000","last_undegraded":"2024-09-15T22:56:22.050392+0000","last_fullsized":"2024-09-15T22:56:22.050392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:48.872012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.006067+0000","last_change":"2024-09-15T22:56:21.057906+0000","last_active":"2024-09-15T22:56:22.006067+0000","last_peered":"2024-09-15T22:56:22.006067+0000","last_clean":"2024-09-15T22:56:22.006067+0000","last_became_active":"2024-09-15T22:56:21.057525+0000","last_became_peered":"2024-09-15T22:56:21.057525+0000","last_unstale":"2024-09-15T22:56:22.006067+0000","last_undegraded":"2024-09-15T22:56:22.006067+0000","last_fullsized":"2024-09-15T22:56:22.006067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:31.529755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180598+0000","last_change":"2024-09-15T22:56:20.025495+0000","last_active":"2024-09-15T22:56:23.180598+0000","last_peered":"2024-09-15T22:56:23.180598+0000","last_clean":"2024-09-15T22:56:23.180598+0000","last_became_active":"2024-09-15T22:56:20.024820+0000","last_became_peered":"2024-09-15T22:56:20.024820+0000","last_unstale":"2024-09-15T22:56:23.180598+0000","last_undegraded":"2024-09-15T22:56:23.180598+0000","last_fullsized":"2024-09-15T22:56:23.180598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.753562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.005745+0000","last_change":"2024-09-15T22:56:21.058064+0000","last_active":"2024-09-15T22:56:22.005745+0000","last_peered":"2024-09-15T22:56:22.005745+0000","last_clean":"2024-09-15T22:56:22.005745+0000","last_became_active":"2024-09-15T22:56:21.057542+0000","last_became_peered":"2024-09-15T22:56:21.057542+0000","last_unstale":"2024-09-15T22:56:22.005745+0000","last_undegraded":"2024-09-15T22:56:22.005745+0000","last_fullsized":"2024-09-15T22:56:22.005745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:00.466208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:23.180466+0000","last_change":"2024-09-15T22:56:20.025564+0000","last_active":"2024-09-15T22:56:23.180466+0000","last_peered":"2024-09-15T22:56:23.180466+0000","last_clean":"2024-09-15T22:56:23.180466+0000","last_became_active":"2024-09-15T22:56:20.024990+0000","last_became_peered":"2024-09-15T22:56:20.024990+0000","last_unstale":"2024-09-15T22:56:23.180466+0000","last_undegraded":"2024-09-15T22:56:23.180466+0000","last_fullsized":"2024-09-15T22:56:23.180466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:31.596992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142530+0000","last_change":"2024-09-15T22:56:21.033186+0000","last_active":"2024-09-15T22:56:22.142530+0000","last_peered":"2024-09-15T22:56:22.142530+0000","last_clean":"2024-09-15T22:56:22.142530+0000","last_became_active":"2024-09-15T22:56:21.030711+0000","last_became_peered":"2024-09-15T22:56:21.030711+0000","last_unstale":"2024-09-15T22:56:22.142530+0000","last_undegraded":"2024-09-15T22:56:22.142530+0000","last_fullsized":"2024-09-15T22:56:22.142530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:06.325170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.218077+0000","last_change":"2024-09-15T22:56:20.010855+0000","last_active":"2024-09-15T22:56:22.218077+0000","last_peered":"2024-09-15T22:56:22.218077+0000","last_clean":"2024-09-15T22:56:22.218077+0000","last_became_active":"2024-09-15T22:56:20.009755+0000","last_became_peered":"2024-09-15T22:56:20.009755+0000","last_unstale":"2024-09-15T22:56:22.218077+0000","last_undegraded":"2024-09-15T22:56:22.218077+0000","last_fullsized":"2024-09-15T22:56:22.218077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:19.423362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.217920+0000","last_change":"2024-09-15T22:56:21.063433+0000","last_active":"2024-09-15T22:56:22.217920+0000","last_peered":"2024-09-15T22:56:22.217920+0000","last_clean":"2024-09-15T22:56:22.217920+0000","last_became_active":"2024-09-15T22:56:21.062367+0000","last_became_peered":"2024-09-15T22:56:21.062367+0000","last_unstale":"2024-09-15T22:56:22.217920+0000","last_undegraded":"2024-09-15T22:56:22.217920+0000","last_fullsized":"2024-09-15T22:56:22.217920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:19.972761+0000","last_clean_scrub_stamp":"2024-09-15T22:56:19.972761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:08.839669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-15T22:56:22.142732+0000","last_change":"2024-09-15T22:56:20.022676+0000","last_active":"2024-09-15T22:56:22.142732+0000","last_peered":"2024-09-15T22:56:22.142732+0000","last_clean":"2024-09-15T22:56:22.142732+0000","last_became_active":"2024-09-15T22:56:20.022467+0000","last_became_peered":"2024-09-15T22:56:20.022467+0000","last_unstale":"2024-09-15T22:56:22.142732+0000","last_undegraded":"2024-09-15T22:56:22.142732+0000","last_fullsized":"2024-09-15T22:56:22.142732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:18.962914+0000","last_clean_scrub_stamp":"2024-09-15T22:56:18.962914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:01.567308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:56:34.155 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:56:34.155 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:56:34.155 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:56:34.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T22:56:34.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.312+0000 7fcf0d38e640 1 Processor -- start 2024-09-15T22:56:34.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.312+0000 7fcf0d38e640 1 -- start start 2024-09-15T22:56:34.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 0x7fcf080b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf080732f0 0x7fcf080ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf080cd150 con 0x7fcf080b4960 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fcf08073760 con 0x7fcf080732f0 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf080b4da0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf080732f0 0x7fcf080ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf080732f0 0x7fcf080ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44196/0 (socket says 172.21.15.28:44196) 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 -- 172.21.15.28:0/1968024765 learned_addr learned my addr 172.21.15.28:0/1968024765 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf06ffd640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 0x7fcf080b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 -- 172.21.15.28:0/1968024765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 msgr2=0x7fcf080b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 0x7fcf080b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 -- 172.21.15.28:0/1968024765 >> v1:172.21.15.131:6789/0 conn(0x7fcf080b4960 legacy=0x7fcf08072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 -- 172.21.15.28:0/1968024765 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf080cd430 con 0x7fcf080732f0 2024-09-15T22:56:34.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf06ffd640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 0x7fcf080b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:34.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf077fe640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf080732f0 0x7fcf080ce1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009e50 tx=0x7fcf0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78ba58ac41768c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf05ffb640 1 -- 172.21.15.28:0/1968024765 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000a5760 con 0x7fcf080732f0 2024-09-15T22:56:34.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf05ffb640 1 -- 172.21.15.28:0/1968024765 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000a5900 con 0x7fcf080732f0 2024-09-15T22:56:34.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf05ffb640 1 -- 172.21.15.28:0/1968024765 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000a5cd0 con 0x7fcf080732f0 2024-09-15T22:56:34.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- 172.21.15.28:0/1968024765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf080732f0 msgr2=0x7fcf080ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf080732f0 0x7fcf080ce1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009e50 tx=0x7fcf0001c9f0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- 172.21.15.28:0/1968024765 shutdown_connections 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf080732f0 0x7fcf080ce1f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/1968024765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0815b1c0 0x7fcf080b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- 172.21.15.28:0/1968024765 >> 172.21.15.28:0/1968024765 conn(0x7fcf0806bcc0 msgr2=0x7fcf0806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- 172.21.15.28:0/1968024765 shutdown_connections 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.316+0000 7fcf0d38e640 1 -- 172.21.15.28:0/1968024765 wait complete. 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 Processor -- start 2024-09-15T22:56:34.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- start start 2024-09-15T22:56:34.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf080732f0 0x7fcf0815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf080b4960 0x7fcf081411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcf080cf0c0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf080cef40 con 0x7fcf080732f0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf080cf240 con 0x7fcf080b4960 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44200/0 (socket says 172.21.15.28:44200) 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 -- 172.21.15.28:0/717197283 learned_addr learned my addr 172.21.15.28:0/717197283 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf06ffd640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf080732f0 0x7fcf0815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 -- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf080b4960 msgr2=0x7fcf081411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf080b4960 0x7fcf081411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 -- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf080732f0 msgr2=0x7fcf0815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf080732f0 0x7fcf0815e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 -- 172.21.15.28:0/717197283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0814aed0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf077fe640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf000af040 tx=0x7fcf00019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b8470 con 0x7fcf0815b1c0 2024-09-15T22:56:34.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000b8670 con 0x7fcf0815b1c0 2024-09-15T22:56:34.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000b8a60 con 0x7fcf0815b1c0 2024-09-15T22:56:34.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0814a630 con 0x7fcf0815b1c0 2024-09-15T22:56:34.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.320+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0814abf0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf080694b0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf000c0020 con 0x7fcf0815b1c0 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fceef7fe640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 0x7fcef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf001206e0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fcf06ffd640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 0x7fcef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.324+0000 7fcf06ffd640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 0x7fcef4069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcef8006fd0 tx=0x7fcef8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.328+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf000c7020 con 0x7fcf0815b1c0 2024-09-15T22:56:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcf080b4fa0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fceef7fe640 1 -- 172.21.15.28:0/717197283 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcf000165e0 con 0x7fcf0815b1c0 2024-09-15T22:56:34.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:34.522 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:56:34.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 msgr2=0x7fcef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 0x7fcef4069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcef8006fd0 tx=0x7fcef8008040 comp rx=0 tx=0).stop 2024-09-15T22:56:34.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 msgr2=0x7fcf08142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf000af040 tx=0x7fcf00019790 comp rx=0 tx=0).stop 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 shutdown_connections 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf0815b1c0 0x7fcf08142890 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf080b4960 0x7fcf081411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcef40678c0 0x7fcef4069d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 --2- 172.21.15.28:0/717197283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf080732f0 0x7fcf0815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 >> 172.21.15.28:0/717197283 conn(0x7fcf0806bcc0 msgr2=0x7fcf080cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.520+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 shutdown_connections 2024-09-15T22:56:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.524+0000 7fcf0d38e640 1 -- 172.21.15.28:0/717197283 wait complete. 2024-09-15T22:56:34.540 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:56:34.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:34.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.656+0000 7f5548648640 1 Processor -- start 2024-09-15T22:56:34.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.656+0000 7f5548648640 1 -- start start 2024-09-15T22:56:34.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5548648640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55400cfb50 0x7f55400d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5548648640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 0x7f55400d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5548648640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55400ced90 con 0x7f554015e680 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5548648640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f55400d1960 con 0x7f55400cfb50 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5548648640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f55400cf070 con 0x7f55400d0fb0 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55400cfb50 0x7f55400d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55400cfb50 0x7f55400d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44208/0 (socket says 172.21.15.28:44208) 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 -- 172.21.15.28:0/3651794543 learned_addr learned my addr 172.21.15.28:0/3651794543 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5546be5640 1 --2- 172.21.15.28:0/3651794543 >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 0x7f55400d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 -- 172.21.15.28:0/3651794543 >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 msgr2=0x7f55400d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 --2- 172.21.15.28:0/3651794543 >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 0x7f55400d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 -- 172.21.15.28:0/3651794543 >> v1:172.21.15.131:6789/0 conn(0x7f554015e680 legacy=0x7f5540162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 -- 172.21.15.28:0/3651794543 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55400cf350 con 0x7f55400cfb50 2024-09-15T22:56:34.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5546be5640 1 --2- 172.21.15.28:0/3651794543 >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 0x7f55400d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:34.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f5545be3640 1 --2- 172.21.15.28:0/3651794543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55400cfb50 0x7f55400d2330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55400698c0 tx=0x7f553001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d0d39598a4348 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f55453e2640 1 -- 172.21.15.28:0/3651794543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300b0070 con 0x7f55400cfb50 2024-09-15T22:56:34.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f55453e2640 1 -- 172.21.15.28:0/3651794543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55300ab600 con 0x7f55400cfb50 2024-09-15T22:56:34.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.660+0000 7f55453e2640 1 -- 172.21.15.28:0/3651794543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab9d0 con 0x7f55400cfb50 2024-09-15T22:56:34.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/3651794543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55400cfb50 msgr2=0x7f55400d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- 172.21.15.28:0/3651794543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55400cfb50 0x7f55400d2330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55400698c0 tx=0x7f553001c4e0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/3651794543 shutdown_connections 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- 172.21.15.28:0/3651794543 >> v2:172.21.15.131:3300/0 conn(0x7f55400d0fb0 0x7f55400d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- 172.21.15.28:0/3651794543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55400cfb50 0x7f55400d2330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/3651794543 >> 172.21.15.28:0/3651794543 conn(0x7f554006c360 msgr2=0x7f554006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/3651794543 shutdown_connections 2024-09-15T22:56:34.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/3651794543 wait complete. 2024-09-15T22:56:34.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 Processor -- start 2024-09-15T22:56:34.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- start start 2024-09-15T22:56:34.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 0x7f55400cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55400d0fb0 0x7f554015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55400d3620 con 0x7f554015e680 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f55400d34a0 con 0x7f55400cfb50 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f55400d37a0 con 0x7f55400d0fb0 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44220/0 (socket says 172.21.15.28:44220) 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 -- 172.21.15.28:0/351959621 learned_addr learned my addr 172.21.15.28:0/351959621 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f55463e4640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 0x7f55400cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5545be3640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55400d0fb0 0x7f554015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 -- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55400d0fb0 msgr2=0x7f554015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55400d0fb0 0x7f554015b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 -- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 msgr2=0x7f55400cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 0x7f55400cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 -- 172.21.15.28:0/351959621 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5540069b70 con 0x7f554015e680 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f55463e4640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 0x7f55400cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5546be5640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f553800cef0 tx=0x7f553800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553801a070 con 0x7f554015e680 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553800d860 con 0x7f554015e680 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553800dc50 con 0x7f554015e680 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55400cd9c0 con 0x7f554015e680 2024-09-15T22:56:34.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.664+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55400cc9a0 con 0x7f554015e680 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55400c7e50 con 0x7f554015e680 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f553801d070 con 0x7f554015e680 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f5536ffd640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 0x7f5524069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5538086500 con 0x7f554015e680 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f55463e4640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 0x7f5524069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.668+0000 7f55463e4640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 0x7f5524069db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a850 tx=0x7f553c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.672+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55380570f0 con 0x7f554015e680 2024-09-15T22:56:34.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.860+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55400ba520 con 0x7f554015e680 2024-09-15T22:56:34.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.860+0000 7f5536ffd640 1 -- 172.21.15.28:0/351959621 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f55380569f0 con 0x7f554015e680 2024-09-15T22:56:34.864 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:34.864 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:34.864 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:34.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 msgr2=0x7f5524069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 0x7f5524069db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a850 tx=0x7f553c008040 comp rx=0 tx=0).stop 2024-09-15T22:56:34.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 msgr2=0x7f55400b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f553800cef0 tx=0x7f553800a710 comp rx=0 tx=0).stop 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 shutdown_connections 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f554015e680 0x7f55400b9030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f55400d0fb0 0x7f554015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f55240678f0 0x7f5524069db0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 --2- 172.21.15.28:0/351959621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55400cfb50 0x7f55400cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 >> 172.21.15.28:0/351959621 conn(0x7f554006c360 msgr2=0x7f554006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 shutdown_connections 2024-09-15T22:56:34.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.864+0000 7f5548648640 1 -- 172.21.15.28:0/351959621 wait complete. 2024-09-15T22:56:34.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:34.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 Processor -- start 2024-09-15T22:56:34.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 -- start start 2024-09-15T22:56:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f191415c170 0x7f1914073c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19140b4370 0x7f19140b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19141600e0 con 0x7f19140b5900 2024-09-15T22:56:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f19140d1b20 con 0x7f19140b4370 2024-09-15T22:56:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1919b70640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f19140b4cf0 con 0x7f191415c170 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1912ffd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19140b4370 0x7f19140b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f19137fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f191415c170 0x7f1914073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1913fff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f19140b5900 0x7f19140b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:33142/0 (socket says 172.21.15.28:33142) 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1913fff640 1 -- 172.21.15.28:0/2630824353 learned_addr learned my addr 172.21.15.28:0/2630824353 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1912ffd640 1 -- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f191415c170 msgr2=0x7f1914073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1912ffd640 1 --2- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f191415c170 0x7f1914073c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1912ffd640 1 -- 172.21.15.28:0/2630824353 >> v1:172.21.15.131:6789/0 conn(0x7f19140b5900 legacy=0x7f19140b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.988+0000 7f1912ffd640 1 -- 172.21.15.28:0/2630824353 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19141603c0 con 0x7f19140b4370 2024-09-15T22:56:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1912ffd640 1 --2- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19140b4370 0x7f19140b47b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19080097c0 tx=0x7f190801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26597e72e193cf3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f19127fc640 1 -- 172.21.15.28:0/2630824353 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080a7070 con 0x7f19140b4370 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f19127fc640 1 -- 172.21.15.28:0/2630824353 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080b0070 con 0x7f19140b4370 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f19127fc640 1 -- 172.21.15.28:0/2630824353 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080ab890 con 0x7f19140b4370 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19140b4370 msgr2=0x7f19140b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19140b4370 0x7f19140b47b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19080097c0 tx=0x7f190801c470 comp rx=0 tx=0).stop 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- 172.21.15.28:0/2630824353 shutdown_connections 2024-09-15T22:56:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19140b4370 0x7f19140b47b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- 172.21.15.28:0/2630824353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f191415c170 0x7f1914073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- 172.21.15.28:0/2630824353 >> 172.21.15.28:0/2630824353 conn(0x7f1914067bd0 msgr2=0x7f1914067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:34.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- 172.21.15.28:0/2630824353 shutdown_connections 2024-09-15T22:56:34.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- 172.21.15.28:0/2630824353 wait complete. 2024-09-15T22:56:34.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 Processor -- start 2024-09-15T22:56:34.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- start start 2024-09-15T22:56:34.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19140b4370 0x7f191415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 0x7f19141f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19140d2ff0 con 0x7f19140b5900 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f191415c550 con 0x7f191415c170 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1919b70640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f191415fd70 con 0x7f19140b4370 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44224/0 (socket says 172.21.15.28:44224) 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.992+0000 7f1912ffd640 1 -- 172.21.15.28:0/3479543849 learned_addr learned my addr 172.21.15.28:0/3479543849 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1913fff640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 0x7f19141f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f19137fe640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19140b4370 0x7f191415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 -- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19140b4370 msgr2=0x7f191415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19140b4370 0x7f191415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 -- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 msgr2=0x7f19141f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 0x7f19141f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 -- 172.21.15.28:0/3479543849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191415c800 con 0x7f19140b5900 2024-09-15T22:56:34.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1913fff640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 0x7f19141f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1912ffd640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19080ad040 tx=0x7f190801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080bf610 con 0x7f19140b5900 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080bf7b0 con 0x7f19140b5900 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191415cae0 con 0x7f19140b5900 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080bfb80 con 0x7f19140b5900 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191415d0a0 con 0x7f19140b5900 2024-09-15T22:56:34.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19140cfec0 con 0x7f19140b5900 2024-09-15T22:56:35.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19080bd020 con 0x7f19140b5900 2024-09-15T22:56:35.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 0x7f1900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1908120790 con 0x7f19140b5900 2024-09-15T22:56:35.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f19137fe640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 0x7f1900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:34.996+0000 7f19137fe640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 0x7f1900069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.000+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19080c6030 con 0x7f19140b5900 2024-09-15T22:56:35.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.196+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1914069450 con 0x7f19140b5900 2024-09-15T22:56:35.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.196+0000 7f18fbfff640 1 -- 172.21.15.28:0/3479543849 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f1908016090 con 0x7f19140b5900 2024-09-15T22:56:35.200 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:35.200 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:35.200 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 msgr2=0x7f1900069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 0x7f1900069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904008040 comp rx=0 tx=0).stop 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 msgr2=0x7f19141f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19080ad040 tx=0x7f190801acb0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 shutdown_connections 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f19000678c0 0x7f1900069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f191415c170 0x7f19141f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19140b5900 0x7f19141f62f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 --2- 172.21.15.28:0/3479543849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19140b4370 0x7f191415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 >> 172.21.15.28:0/3479543849 conn(0x7f1914067bd0 msgr2=0x7f19140d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 shutdown_connections 2024-09-15T22:56:35.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.200+0000 7f1919b70640 1 -- 172.21.15.28:0/3479543849 wait complete. 2024-09-15T22:56:35.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:35.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 Processor -- start 2024-09-15T22:56:35.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 -- start start 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 0x7f6fb00d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00ced90 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00cf070 con 0x7f6fb015e680 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fb5b03640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb00cf350 con 0x7f6fb00cfb50 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6fb00d0fb0 0x7f6fb00d2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58684/0 (socket says 172.21.15.28:58684) 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faffff640 1 -- 172.21.15.28:0/1019369203 learned_addr learned my addr 172.21.15.28:0/1019369203 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982100931 0 0) 0x7f6fb00ced90 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9c003530 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 0x7f6fb00d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3787586031 0 0) 0x7f6f9c003530 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 msgr2=0x7f6fb00d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 0x7f6fb00d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 >> v1:172.21.15.131:6789/0 conn(0x7f6fb015e680 legacy=0x7f6fb0162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb00cf630 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f6fa8001a00 con 0x7f6fb00d0fb0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 >> v1:172.21.15.28:6789/0 conn(0x7f6fb00d0fb0 legacy=0x7f6fb00d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f9c0039f0 0x7f6f9c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c004810 0x7f6f9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 0x7f6f9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00cf350 con 0x7f6f9c0039f0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c00bab0 con 0x7f6f9c004810 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c00bcb0 con 0x7f6fb00cfb50 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f9c0039f0 0x7f6f9c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c004810 0x7f6f9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 -- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 msgr2=0x7f6f9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00cfb50 0x7f6f9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 -- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c004810 msgr2=0x7f6f9c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c004810 0x7f6f9c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6faf7fe640 1 -- 172.21.15.28:0/1019369203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c003530 con 0x7f6f9c0039f0 2024-09-15T22:56:35.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.328+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c004810 0x7f6f9c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f9c0039f0 0x7f6f9c003df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0007fd0 tx=0x7f6fa001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ec4e03503dbe4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0001380 con 0x7f6f9c0039f0 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa00052f0 con 0x7f6f9c0039f0 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faeffd640 1 -- 172.21.15.28:0/1019369203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0003860 con 0x7f6f9c0039f0 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/1019369203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f9c0039f0 msgr2=0x7f6f9c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/1019369203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f9c0039f0 0x7f6f9c003df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0007fd0 tx=0x7f6fa001c3e0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faffff640 1 -- 172.21.15.28:0/1019369203 reap_dead start 2024-09-15T22:56:35.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/1019369203 shutdown_connections 2024-09-15T22:56:35.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/1019369203 >> 172.21.15.28:0/1019369203 conn(0x7f6fb006c360 msgr2=0x7f6fb006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/1019369203 shutdown_connections 2024-09-15T22:56:35.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/1019369203 wait complete. 2024-09-15T22:56:35.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 Processor -- start 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- start start 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c0039f0 0x7f6fb0156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00ca4a0 0x7f6fb00ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb016a7c0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00d39a0 con 0x7f6f9c0039f0 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb016a940 con 0x7f6fb00ca4a0 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44234/0 (socket says 172.21.15.28:44234) 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 -- 172.21.15.28:0/527507980 learned_addr learned my addr 172.21.15.28:0/527507980 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c0039f0 0x7f6fb0156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 -- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00ca4a0 msgr2=0x7f6fb00ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00ca4a0 0x7f6fb00ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 -- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c0039f0 msgr2=0x7f6fb0156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c0039f0 0x7f6fb0156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 -- 172.21.15.28:0/527507980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb01619e0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fa7fff640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800e810 tx=0x7f6f9800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98017070 con 0x7f6fb00b6b90 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9800c6d0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.332+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb0161cc0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800f040 con 0x7f6fb00b6b90 2024-09-15T22:56:35.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb00b4e70 con 0x7f6fb00b6b90 2024-09-15T22:56:35.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb00d2a80 con 0x7f6fb00b6b90 2024-09-15T22:56:35.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f9801a070 con 0x7f6fb00b6b90 2024-09-15T22:56:35.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6facff9640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 0x7f6f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f980857d0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 0x7f6f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.336+0000 7f6faf7fe640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 0x7f6f90069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ac000 tx=0x7f6fa0001140 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.340+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6f980563a0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.496+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fb00ba520 con 0x7f6fb00b6b90 2024-09-15T22:56:35.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.496+0000 7f6facff9640 1 -- 172.21.15.28:0/527507980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7f6f98055ca0 con 0x7f6fb00b6b90 2024-09-15T22:56:35.500 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:35.500 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 msgr2=0x7f6f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 0x7f6f90069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ac000 tx=0x7f6fa0001140 comp rx=0 tx=0).stop 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 msgr2=0x7f6fb00b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800e810 tx=0x7f6f9800ecd0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 shutdown_connections 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fb00ca4a0 0x7f6fb00ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6fb00b6b90 0x7f6fb00b5390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6f900678c0 0x7f6f90069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 --2- 172.21.15.28:0/527507980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f9c0039f0 0x7f6fb0156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 >> 172.21.15.28:0/527507980 conn(0x7f6fb006c360 msgr2=0x7f6fb015db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 shutdown_connections 2024-09-15T22:56:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.500+0000 7f6fb5b03640 1 -- 172.21.15.28:0/527507980 wait complete. 2024-09-15T22:56:35.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:35.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.624+0000 7f00dace3640 1 Processor -- start 2024-09-15T22:56:35.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.624+0000 7f00dace3640 1 -- start start 2024-09-15T22:56:35.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00dace3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f00d40b4710 0x7f00d40b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00dace3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 0x7f00d415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00dace3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d40b4bd0 con 0x7f00d40cde30 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00dace3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f00d415f260 con 0x7f00d40b4710 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00dace3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f00d40b4080 con 0x7f00d40ce210 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d9280640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 0x7f00d415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d3fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f00d40b4710 0x7f00d40b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d9280640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 0x7f00d415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:40904/0 (socket says 172.21.15.28:40904) 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d9280640 1 -- 172.21.15.28:0/2178805649 learned_addr learned my addr 172.21.15.28:0/2178805649 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d3fff640 1 -- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 msgr2=0x7f00d415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d3fff640 1 --2- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 0x7f00d415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d3fff640 1 -- 172.21.15.28:0/2178805649 >> v1:172.21.15.131:6789/0 conn(0x7f00d40cde30 legacy=0x7f00d40ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.628+0000 7f00d3fff640 1 -- 172.21.15.28:0/2178805649 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d40b4eb0 con 0x7f00d40b4710 2024-09-15T22:56:35.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d3fff640 1 --2- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d40b3b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0097f0 tx=0x7f00bc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4878a538b3643b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d37fe640 1 -- 172.21.15.28:0/2178805649 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0b0070 con 0x7f00d40b4710 2024-09-15T22:56:35.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d37fe640 1 -- 172.21.15.28:0/2178805649 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc0ab600 con 0x7f00d40b4710 2024-09-15T22:56:35.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d37fe640 1 -- 172.21.15.28:0/2178805649 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0ab9d0 con 0x7f00d40b4710 2024-09-15T22:56:35.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 msgr2=0x7f00d40b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d40b3b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0097f0 tx=0x7f00bc01c3e0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- 172.21.15.28:0/2178805649 shutdown_connections 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40ce210 0x7f00d415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- 172.21.15.28:0/2178805649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d40b3b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- 172.21.15.28:0/2178805649 >> 172.21.15.28:0/2178805649 conn(0x7f00d406bcc0 msgr2=0x7f00d406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- 172.21.15.28:0/2178805649 shutdown_connections 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- 172.21.15.28:0/2178805649 wait complete. 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 Processor -- start 2024-09-15T22:56:35.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- start start 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d4147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 0x7f00d415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00d40d0050 con 0x7f00d40ce210 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f00d40cfed0 con 0x7f00d40b4710 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00dace3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f00d40d01d0 con 0x7f00d40cde30 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44244/0 (socket says 172.21.15.28:44244) 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 -- 172.21.15.28:0/2413269591 learned_addr learned my addr 172.21.15.28:0/2413269591 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d8a7f640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d4147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d3fff640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 0x7f00d415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 -- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 msgr2=0x7f00d415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 0x7f00d415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 -- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 msgr2=0x7f00d4147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d4147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 -- 172.21.15.28:0/2413269591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d4151cb0 con 0x7f00d40ce210 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d8a7f640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d4147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d3fff640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 0x7f00d415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.632+0000 7f00d9280640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efc0 tx=0x7f00cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00ccc0 con 0x7f00d40ce210 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc0039a0 con 0x7f00d40ce210 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d4151f90 con 0x7f00d40ce210 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00ce60 con 0x7f00d40ce210 2024-09-15T22:56:35.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d4152550 con 0x7f00d40ce210 2024-09-15T22:56:35.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d40b3b40 con 0x7f00d40ce210 2024-09-15T22:56:35.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00cc012050 con 0x7f00d40ce210 2024-09-15T22:56:35.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 0x7f00b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00cc0860c0 con 0x7f00d40ce210 2024-09-15T22:56:35.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d8a7f640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 0x7f00b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.636+0000 7f00d8a7f640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 0x7f00b4069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001710 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.640+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00cc010040 con 0x7f00d40ce210 2024-09-15T22:56:35.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00d40d0eb0 con 0x7f00d40ce210 2024-09-15T22:56:35.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00d17fa640 1 -- 172.21.15.28:0/2413269591 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f00cc056c00 con 0x7f00d40ce210 2024-09-15T22:56:35.838 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:35.838 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:35.839 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:35.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 msgr2=0x7f00b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 0x7f00b4069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001710 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 msgr2=0x7f00d415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efc0 tx=0x7f00cc00c490 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 shutdown_connections 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40ce210 0x7f00d415cdf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d40cde30 0x7f00d415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f00b40678f0 0x7f00b4069db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 --2- 172.21.15.28:0/2413269591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40b4710 0x7f00d4147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.836+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 >> 172.21.15.28:0/2413269591 conn(0x7f00d406bcc0 msgr2=0x7f00d415ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.840+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 shutdown_connections 2024-09-15T22:56:35.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:35.840+0000 7f00dace3640 1 -- 172.21.15.28:0/2413269591 wait complete. 2024-09-15T22:56:36.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:56:20.357916+0000', 'modified': '2024-09-15T22:56:23.380764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6834/41160339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6832', 'nonce': 41160339}, {'type': 'v1', 'addr': '172.21.15.131:6834', 'nonce': 41160339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-09-15T22:56:36.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:56:36.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T22:56:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 Processor -- start 2024-09-15T22:56:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 -- start start 2024-09-15T22:56:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d0145970 0x7f91d00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f91d00d0360 0x7f91d00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d00d0960 con 0x7f91d00b2300 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f91d00b2770 con 0x7f91d0145970 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d8470640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f91d00d0f20 con 0x7f91d00d0360 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d0145970 0x7f91d00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d0145970 0x7f91d00b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44258/0 (socket says 172.21.15.28:44258) 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d5a0b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f91d00b2300 0x7f91d00cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58698/0 (socket says 172.21.15.28:58698) 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 -- 172.21.15.28:0/2067867931 learned_addr learned my addr 172.21.15.28:0/2067867931 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/2067867931 >> v2:172.21.15.131:3300/0 conn(0x7f91d00d0360 0x7f91d00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 -- 172.21.15.28:0/2067867931 >> v2:172.21.15.131:3300/0 conn(0x7f91d00d0360 msgr2=0x7f91d00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 --2- 172.21.15.28:0/2067867931 >> v2:172.21.15.131:3300/0 conn(0x7f91d00d0360 0x7f91d00cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 -- 172.21.15.28:0/2067867931 >> v1:172.21.15.28:6789/0 conn(0x7f91d00b2300 legacy=0x7f91d00cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.392+0000 7f91d620c640 1 -- 172.21.15.28:0/2067867931 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d00d0c40 con 0x7f91d0145970 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d620c640 1 --2- 172.21.15.28:0/2067867931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d0145970 0x7f91d00b1dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009870 tx=0x7f91cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686422a1eaac9c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d520a640 1 -- 172.21.15.28:0/2067867931 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0b1070 con 0x7f91d0145970 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d520a640 1 -- 172.21.15.28:0/2067867931 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc0ac600 con 0x7f91d0145970 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d520a640 1 -- 172.21.15.28:0/2067867931 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0ac9d0 con 0x7f91d0145970 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- 172.21.15.28:0/2067867931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d0145970 msgr2=0x7f91d00b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 --2- 172.21.15.28:0/2067867931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d0145970 0x7f91d00b1dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009870 tx=0x7f91cc01c490 comp rx=0 tx=0).stop 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- 172.21.15.28:0/2067867931 shutdown_connections 2024-09-15T22:56:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 --2- 172.21.15.28:0/2067867931 >> v2:172.21.15.131:3300/0 conn(0x7f91d00d0360 0x7f91d00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 --2- 172.21.15.28:0/2067867931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d0145970 0x7f91d00b1dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- 172.21.15.28:0/2067867931 >> 172.21.15.28:0/2067867931 conn(0x7f91d006bcc0 msgr2=0x7f91d006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- 172.21.15.28:0/2067867931 shutdown_connections 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- 172.21.15.28:0/2067867931 wait complete. 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 Processor -- start 2024-09-15T22:56:36.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.396+0000 7f91d8470640 1 -- start start 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d00d0360 0x7f91d013b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d0145970 0x7f91d00aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91d00cebd0 con 0x7f91d00b2300 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91d00cea50 con 0x7f91d00d0360 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91d00ced50 con 0x7f91d0145970 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44262/0 (socket says 172.21.15.28:44262) 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 -- 172.21.15.28:0/1608081068 learned_addr learned my addr 172.21.15.28:0/1608081068 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d00d0360 0x7f91d013b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d0145970 0x7f91d00aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 -- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d0145970 msgr2=0x7f91d00aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d0145970 0x7f91d00aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 -- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d00d0360 msgr2=0x7f91d013b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d00d0360 0x7f91d013b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 -- 172.21.15.28:0/1608081068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d013c210 con 0x7f91d00b2300 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d620c640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91cc01a0c0 tx=0x7f91cc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 -- 172.21.15.28:0/1608081068 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0bb020 con 0x7f91d00b2300 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 -- 172.21.15.28:0/1608081068 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc0b7620 con 0x7f91d00b2300 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d013c4f0 con 0x7f91d00b2300 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 -- 172.21.15.28:0/1608081068 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0b1040 con 0x7f91d00b2300 2024-09-15T22:56:36.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d01403a0 con 0x7f91d00b2300 2024-09-15T22:56:36.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 -- 172.21.15.28:0/1608081068 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91cc0be020 con 0x7f91d00b2300 2024-09-15T22:56:36.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 0x7f91b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91c6ffd640 1 -- 172.21.15.28:0/1608081068 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91cc11fb80 con 0x7f91d00b2300 2024-09-15T22:56:36.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.400+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 0x7f91b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 0x7f91b4069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91d00aec30 tx=0x7f91c0007cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 Processor -- start 2024-09-15T22:56:36.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- start start 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562292778290 0x562292778670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56229265fb60 con 0x5622927c2440 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5622925c6c70 con 0x562292778290 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56229256ced0 con 0x5622927c1b20 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44268/0 (socket says 172.21.15.28:44268) 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 -- 172.21.15.28:0/554440211 learned_addr learned my addr 172.21.15.28:0/554440211 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562292778290 0x562292778670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d620c640 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 -- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 msgr2=0x5622927c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 -- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562292778290 msgr2=0x562292778670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562292778290 0x562292778670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 -- 172.21.15.28:0/554440211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229257ee50 con 0x5622927c2440 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91c00076a0 tx=0x7f91c0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc32bcfe5d77ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91b3fff640 1 -- 172.21.15.28:0/554440211 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0004c80 con 0x5622927c2440 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91b3fff640 1 -- 172.21.15.28:0/554440211 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0004e20 con 0x5622927c2440 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91b3fff640 1 -- 172.21.15.28:0/554440211 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005250 con 0x5622927c2440 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- 172.21.15.28:0/554440211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 msgr2=0x562292777d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91c00076a0 tx=0x7f91c0011000 comp rx=0 tx=0).stop 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- 172.21.15.28:0/554440211 shutdown_connections 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562292778290 0x562292778670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x562292777d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 --2- 172.21.15.28:0/554440211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- 172.21.15.28:0/554440211 >> 172.21.15.28:0/554440211 conn(0x56229277e600 msgr2=0x562292776630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- 172.21.15.28:0/554440211 shutdown_connections 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- 172.21.15.28:0/554440211 wait complete. 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 -- start start 2024-09-15T22:56:36.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.404+0000 7f91db52c000 1 Processor -- start 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x562292782cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56229277d390 0x562292783230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562292628b00 con 0x5622927c1b20 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5622925a1360 con 0x5622927c2440 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x56229259e2d0 con 0x56229277d390 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 10 client.0 _ll_register_callbacks cb 0x562292763820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44282/0 (socket says 172.21.15.28:44282) 2024-09-15T22:56:36.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 -- 172.21.15.28:0/3778125035 learned_addr learned my addr 172.21.15.28:0/3778125035 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x562292782cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56229277d390 0x562292783230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 -- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56229277d390 msgr2=0x562292783230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56229277d390 0x562292783230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 -- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 msgr2=0x562292782cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x562292782cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 -- 172.21.15.28:0/3778125035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229256d120 con 0x5622927c1b20 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d620c640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91cc097e70 tx=0x7f91cc0f07e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a060747fba3121 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0f8cc0 con 0x5622927c1b20 2024-09-15T22:56:36.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91cc0ee3e0 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c0004e20 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f91cc11c050 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 10 client.4581 fetch_fsmap learned FSMap version 7 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562292566450 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0004e20 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f91cc0b4030 con 0x5622927c1b20 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 10 client.4581 fetch_fsmap finished waiting for FSMap version 7 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 10 client.4581 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 20 client.4581 populate_metadata read hostname 'smithi028' 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927d0280 0x5622927d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 4 client.4581 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 --> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562292560c00 con 0x5622927d0280 2024-09-15T22:56:36.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927d0280 0x5622927d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91b17fa640 10 client.4581 ms_handle_connect on v2:172.21.15.131:6832/41160339 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.408+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927d0280 0x5622927d2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2554acc51f15acb server_cookie=f4c32cf2206ea127 in_seq=0 out_seq=0 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91b17fa640 1 -- 172.21.15.28:0/3778125035 <== mds.0 v2:172.21.15.131:6832/41160339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562292560c00 con 0x5622927d0280 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91b17fa640 10 client.4581 handle_command_reply: tid=0 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 client.4581 shutdown 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 msgr2=0x56229277ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91cc097e70 tx=0x7f91cc0f07e0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 shutdown_connections 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927d0280 0x5622927d2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56229277d390 0x562292783230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x562292782cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 --2- 172.21.15.28:0/3778125035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c1b20 0x56229277ce50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91b17fa640 0 client.4581 ms_handle_reset on v2:172.21.15.131:6832/41160339 2024-09-15T22:56:36.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 >> 172.21.15.28:0/3778125035 conn(0x562292778290 msgr2=0x562292776d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 shutdown_connections 2024-09-15T22:56:36.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 1 -- 172.21.15.28:0/3778125035 wait complete. 2024-09-15T22:56:36.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.412+0000 7f91db52c000 20 client.4581 trim_cache size 0 max 16384 2024-09-15T22:56:36.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 Processor -- start 2024-09-15T22:56:36.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 -- start start 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x5622927d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91d02006d0 con 0x56229277d390 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01ffa30 con 0x5622927c2440 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91d0200080 con 0x5622927c1b20 2024-09-15T22:56:36.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44298/0 (socket says 172.21.15.28:44298) 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 -- 172.21.15.28:0/64889138 learned_addr learned my addr 172.21.15.28:0/64889138 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 -- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 msgr2=0x5622927c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 -- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 msgr2=0x5622927d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x5622927d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.428+0000 7f91d620c640 1 -- 172.21.15.28:0/64889138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229254dfd0 con 0x56229277d390 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d620c640 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0ee390 tx=0x7f91cc0c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2370aa4e65b7cc32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b37fe640 1 -- 172.21.15.28:0/64889138 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0f8cc0 con 0x56229277d390 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b37fe640 1 -- 172.21.15.28:0/64889138 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc1080d0 con 0x56229277d390 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b37fe640 1 -- 172.21.15.28:0/64889138 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0f8a50 con 0x56229277d390 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/64889138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 msgr2=0x5622927c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0ee390 tx=0x7f91cc0c2000 comp rx=0 tx=0).stop 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/64889138 shutdown_connections 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622927c2440 0x5622927d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- 172.21.15.28:0/64889138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56229277d390 0x5622927c0cf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/64889138 >> 172.21.15.28:0/64889138 conn(0x562292778290 msgr2=0x56229277c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/64889138 shutdown_connections 2024-09-15T22:56:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/64889138 wait complete. 2024-09-15T22:56:36.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- start start 2024-09-15T22:56:36.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 Processor -- start 2024-09-15T22:56:36.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56229277d390 0x5622927d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5622925c5f80 con 0x5622927c2440 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x56229257eca0 con 0x56229277d390 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5622925cb2a0 con 0x5622927c1b20 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 10 client.0 _ll_register_callbacks cb 0x7f91cc006d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44304/0 (socket says 172.21.15.28:44304) 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 -- 172.21.15.28:0/2630667630 learned_addr learned my addr 172.21.15.28:0/2630667630 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d620c640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56229277d390 0x5622927d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 -- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 msgr2=0x5622927f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 -- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56229277d390 msgr2=0x5622927d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56229277d390 0x5622927d5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 -- 172.21.15.28:0/2630667630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562292649750 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d5a0b640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91d6a0d640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91c80126d0 tx=0x7f91c8012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe9eab8ccbef0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c80039a0 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91cc1080d0 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91c8003b40 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f91c8003d40 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 10 client.4587 fetch_fsmap learned FSMap version 7 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562292554a30 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc1080d0 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f91c8024050 con 0x5622927c2440 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 10 client.4587 fetch_fsmap finished waiting for FSMap version 7 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 10 client.4587 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:56:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 20 client.4587 populate_metadata read hostname 'smithi028' 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927f57f0 0x562292838ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 4 client.4587 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.432+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 --> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] -- command(tid 0: {"prefix": "status"}) -- 0x5622925d43a0 con 0x5622927f57f0 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d620c640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927f57f0 0x562292838ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d620c640 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927f57f0 0x562292838ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14bd5696620a61ee server_cookie=4985831392ac3026 in_seq=0 out_seq=0 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91b17fa640 10 client.4587 ms_handle_connect on v2:172.21.15.131:6832/41160339 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91b17fa640 1 -- 172.21.15.28:0/2630667630 <== mds.0 v2:172.21.15.131:6832/41160339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5622925d43a0 con 0x5622927f57f0 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91b17fa640 10 client.4587 handle_command_reply: tid=0 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 client.4587 shutdown 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 msgr2=0x5622927f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91c80126d0 tx=0x7f91c8012ad0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 shutdown_connections 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:6832/41160339,v1:172.21.15.131:6834/41160339] conn(0x5622927f57f0 0x562292838ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5622927c2440 0x5622927f52b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622927c1b20 0x5622927f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 --2- 172.21.15.28:0/2630667630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56229277d390 0x5622927d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91b17fa640 0 client.4587 ms_handle_reset on v2:172.21.15.131:6832/41160339 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 >> 172.21.15.28:0/2630667630 conn(0x562292778290 msgr2=0x5622927bfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 shutdown_connections 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 1 -- 172.21.15.28:0/2630667630 wait complete. 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91db52c000 20 client.4587 trim_cache size 0 max 16384 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "f44574f1-d935-4d4e-b79e-1e1910665f93", 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4285, 2024-09-15T22:56:36.442 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 15.398470188999999, 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 7, 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 20, 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 20, 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 21.141968653999999 2024-09-15T22:56:36.443 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 msgr2=0x7f91b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 0x7f91b4069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f91d00aec30 tx=0x7f91c0007cf0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 msgr2=0x7f91d013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91cc01a0c0 tx=0x7f91cc01acd0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 shutdown_connections 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d0145970 0x7f91d00aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91b40678c0 0x7f91b4069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d00d0360 0x7f91d013b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 --2- 172.21.15.28:0/1608081068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d00b2300 0x7f91d013f060 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 >> 172.21.15.28:0/1608081068 conn(0x7f91d006bcc0 msgr2=0x7f91d0142970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 shutdown_connections 2024-09-15T22:56:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.436+0000 7f91d8470640 1 -- 172.21.15.28:0/1608081068 wait complete. 2024-09-15T22:56:36.454 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:56:36.463 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:56:36.464 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:56:36.464 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:56:36.464 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T22:56:36.487 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T22:56:36.487 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-15T22:56:36.488 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:36.488 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:36.488 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:56:36.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:36.488 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-15T22:56:36.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:56:36.489 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:36.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:36.489 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-15T22:56:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:36.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-15T22:56:36.557 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-09-15T22:56:36.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:56:36.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:36.558 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:56:36.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:36.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-09-15T22:56:36.625 INFO:teuthology.orchestra.run.smithi028.stderr:Cannot find device "ceph-brx" 2024-09-15T22:56:36.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:56:36.627 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T22:56:36.627 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T22:56:36.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:56:36.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.800+0000 7fc81d7a2640 1 Processor -- start 2024-09-15T22:56:36.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.800+0000 7fc81d7a2640 1 -- start start 2024-09-15T22:56:36.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc81d7a2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc81806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc81d7a2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8180d0290 con 0x7fc81806d310 2024-09-15T22:56:36.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc81d7a2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc818071d30 con 0x7fc8180cfd60 2024-09-15T22:56:36.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc81d7a2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc81806d750 con 0x7fc81815b0a0 2024-09-15T22:56:36.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc80ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc81806d310 0x7fc8180cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58710/0 (socket says 172.21.15.28:58710) 2024-09-15T22:56:36.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc80ffff640 1 -- 172.21.15.28:0/2743835314 learned_addr learned my addr 172.21.15.28:0/2743835314 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc81806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778559040 0 0) 0x7fc8180d0290 con 0x7fc81806d310 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc804003530 con 0x7fc81806d310 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409068215 0 0) 0x7fc804003530 con 0x7fc81806d310 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 msgr2=0x7fc81806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc81806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 >> v1:172.21.15.131:6789/0 conn(0x7fc8180cfd60 legacy=0x7fc818072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc818072010 con 0x7fc81806d310 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fc800001680 con 0x7fc81806d310 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 >> v1:172.21.15.28:6789/0 conn(0x7fc81806d310 legacy=0x7fc8180cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8040039f0 0x7fc804003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc804004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc804004d50 0x7fc8040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc81806d750 con 0x7fc8040039f0 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc80400bb60 con 0x7fc804004d50 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc80400bd30 con 0x7fc81815b0a0 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8040039f0 0x7fc804003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc80ffff640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc804004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 -- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 msgr2=0x7fc804004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8177fe640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc804004d50 0x7fc8040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc804004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 -- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc804004d50 msgr2=0x7fc8040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:36.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc804004d50 0x7fc8040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc816ffd640 1 -- 172.21.15.28:0/2743835314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc804003530 con 0x7fc8040039f0 2024-09-15T22:56:36.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc80ffff640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc81815b0a0 0x7fc804004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:36.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.804+0000 7fc8177fe640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc804004d50 0x7fc8040051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc816ffd640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8040039f0 0x7fc804003e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ae0 tx=0x7fc80801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5c864f357ca2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080b2070 con 0x7fc8040039f0 2024-09-15T22:56:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8080a5510 con 0x7fc8040039f0 2024-09-15T22:56:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8167fc640 1 -- 172.21.15.28:0/2743835314 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080096b0 con 0x7fc8040039f0 2024-09-15T22:56:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- 172.21.15.28:0/2743835314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8040039f0 msgr2=0x7fc804003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/2743835314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8040039f0 0x7fc804003e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ae0 tx=0x7fc80801ca30 comp rx=0 tx=0).stop 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 -- 172.21.15.28:0/2743835314 reap_dead start 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- 172.21.15.28:0/2743835314 shutdown_connections 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- 172.21.15.28:0/2743835314 >> 172.21.15.28:0/2743835314 conn(0x7fc8180cdbe0 msgr2=0x7fc8180cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- 172.21.15.28:0/2743835314 shutdown_connections 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- 172.21.15.28:0/2743835314 wait complete. 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 Processor -- start 2024-09-15T22:56:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- start start 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8040039f0 0x7fc818152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 0x7fc8181564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc818073b90 con 0x7fc81815d970 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc818073a10 con 0x7fc8040039f0 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc81d7a2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc818073d10 con 0x7fc818156070 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44308/0 (socket says 172.21.15.28:44308) 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 -- 172.21.15.28:0/372420103 learned_addr learned my addr 172.21.15.28:0/372420103 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc816ffd640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8040039f0 0x7fc818152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc80ffff640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 0x7fc8181564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 -- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 msgr2=0x7fc8181564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 0x7fc8181564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 -- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8040039f0 msgr2=0x7fc818152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8040039f0 0x7fc818152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc8177fe640 1 -- 172.21.15.28:0/372420103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8180b4e70 con 0x7fc81815d970 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.808+0000 7fc80ffff640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 0x7fc8181564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc8177fe640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8180b0d30 tx=0x7fc81000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810006d60 con 0x7fc81815d970 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810003980 con 0x7fc81815d970 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810003d70 con 0x7fc81815d970 2024-09-15T22:56:36.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8180b5150 con 0x7fc81815d970 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8180b5710 con 0x7fc81815d970 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8180cf650 con 0x7fc81815d970 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc81001b020 con 0x7fc81815d970 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 0x7fc7f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc810085500 con 0x7fc81815d970 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc816ffd640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 0x7fc7f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:36.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.812+0000 7fc816ffd640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 0x7fc7f8069db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8080af000 tx=0x7fc808008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:36.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:36.816+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc81001ce50 con 0x7fc81815d970 2024-09-15T22:56:37.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc81806edf0 con 0x7fc81815d970 2024-09-15T22:56:37.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc80f7fe640 1 -- 172.21.15.28:0/372420103 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fc810055fb0 con 0x7fc81815d970 2024-09-15T22:56:37.018 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:56:37.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 msgr2=0x7fc7f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 0x7fc7f8069db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8080af000 tx=0x7fc808008040 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 msgr2=0x7fc81815ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8180b0d30 tx=0x7fc81000dc00 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 shutdown_connections 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc81815d970 0x7fc81815ddf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc818156070 0x7fc8181564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc7f80678f0 0x7fc7f8069db0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 --2- 172.21.15.28:0/372420103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8040039f0 0x7fc818152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 >> 172.21.15.28:0/372420103 conn(0x7fc8180cdbe0 msgr2=0x7fc818158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 shutdown_connections 2024-09-15T22:56:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37.016+0000 7fc81d7a2640 1 -- 172.21.15.28:0/372420103 wait complete. 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:56:37.036 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:56:37.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:37.037 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:56:37.042 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:37.042 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:56:37.043 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42459sec preferred_lft 42459sec 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:56:37.044 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:37.044 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:56:37.045 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:37.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:37.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:37.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:37.166 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:56:37.216 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:56:37.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:37.218 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:56:37.279 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:56:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:56:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:56:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:56:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:56:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:56:37.280 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:37.281 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:37.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:56:37.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:56:37.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:56:37.281 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:37.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:37.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:37.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:37.393 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:56:37.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:37.441 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-09-15T22:56:37.489 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:37.489 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:37.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:37.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:56:37.489 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:37.610 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:56:37.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:56:37.611 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:37.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:37.852 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:37.852 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:37.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:56:37.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:56:37.852 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:37.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:37.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:37.914 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:56:37.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:37.914 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:37.960 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:56:37.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:37.961 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:38.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:38.071 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:38.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:38.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:38.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:38.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:38.127 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:38.173 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:56:38.173 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:56:38.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:38.232 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:38.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:38.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:38.288 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:38.302 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:56:38.300+0000 7fbaaac49580 -1 init, newargv = 0x5627c2651fc0 newargc=15 2024-09-15T22:56:38.302 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[35767]: starting ceph client 2024-09-15T22:56:38.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[35767]: starting fuse 2024-09-15T22:56:39.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:39.423 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:39.472 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:39.472 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:39.472 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:39.473 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:39.474 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:39.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:39.475 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:39.521 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:56:39.521 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:56:39.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:56:39.521 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:56:39.521 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:56:39.521 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:56:39.522 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:56:39.523 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:56:39.523 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:56:39.523 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:39.523 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:56:39.523 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:56:39.648 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.35767.asok 2024-09-15T22:56:39.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:39.660 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35767.asok 2024-09-15T22:56:39.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:39.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35767.asok status 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "35767", 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:56:39.822 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4599, 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 4599 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2592354395 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:56:39.823 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2592354395 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.4599 192.168.0.1:0/2592354395", 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/2592354395", 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 7, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 20, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:56:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:56:39.836 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T22:56:39.836 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:56:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 Processor -- start 2024-09-15T22:56:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 -- start start 2024-09-15T22:56:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9806d870 0x7f5c9806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c980b3610 0x7f5c980d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9806e190 con 0x7f5c9815e820 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5c980d2ba0 con 0x7f5c980b3610 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9ed3b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5c980d2e80 con 0x7f5c9806d870 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c980b3610 0x7f5c980d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c980b3610 0x7f5c980d3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44324/0 (socket says 172.21.15.28:44324) 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c97fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5c9815e820 0x7f5c980cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58712/0 (socket says 172.21.15.28:58712) 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 -- 172.21.15.28:0/3556313090 learned_addr learned my addr 172.21.15.28:0/3556313090 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9cad7640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9806d870 0x7f5c9806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 -- 172.21.15.28:0/3556313090 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9806d870 msgr2=0x7f5c9806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9806d870 0x7f5c9806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 -- 172.21.15.28:0/3556313090 >> v1:172.21.15.28:6789/0 conn(0x7f5c9815e820 legacy=0x7f5c980cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.964+0000 7f5c9d2d8640 1 -- 172.21.15.28:0/3556313090 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c980d3160 con 0x7f5c980b3610 2024-09-15T22:56:39.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9d2d8640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980b3610 0x7f5c980d3c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e50 tx=0x7f5c9001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8684e011e1140f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:39.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c977fe640 1 -- 172.21.15.28:0/3556313090 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a58d0 con 0x7f5c980b3610 2024-09-15T22:56:39.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c977fe640 1 -- 172.21.15.28:0/3556313090 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c900a5a70 con 0x7f5c980b3610 2024-09-15T22:56:39.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c977fe640 1 -- 172.21.15.28:0/3556313090 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a5e40 con 0x7f5c980b3610 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3556313090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980b3610 msgr2=0x7f5c980d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980b3610 0x7f5c980d3c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009e50 tx=0x7f5c9001ca00 comp rx=0 tx=0).stop 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3556313090 shutdown_connections 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980b3610 0x7f5c980d3c40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3556313090 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9806d870 0x7f5c9806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3556313090 >> 172.21.15.28:0/3556313090 conn(0x7f5c980d4910 msgr2=0x7f5c980d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3556313090 shutdown_connections 2024-09-15T22:56:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3556313090 wait complete. 2024-09-15T22:56:39.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 Processor -- start 2024-09-15T22:56:39.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- start start 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 0x7f5c98152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9815e820 0x7f5c98153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9816b530 con 0x7f5c9806d870 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9816b3b0 con 0x7f5c980b3610 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.968+0000 7f5c9ed3b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9816b6b0 con 0x7f5c9815e820 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44330/0 (socket says 172.21.15.28:44330) 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 -- 172.21.15.28:0/3998151494 learned_addr learned my addr 172.21.15.28:0/3998151494 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9d2d8640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9815e820 0x7f5c98153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c97fff640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 0x7f5c98152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 -- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9815e820 msgr2=0x7f5c98153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9815e820 0x7f5c98153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 -- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 msgr2=0x7f5c98152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 0x7f5c98152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 -- 172.21.15.28:0/3998151494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9815e3d0 con 0x7f5c9806d870 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c97fff640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 0x7f5c98152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9cad7640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d800 tx=0x7f5c8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800b6c0 con 0x7f5c9806d870 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c88019070 con 0x7f5c9806d870 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9815cf90 con 0x7f5c9806d870 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800ba60 con 0x7f5c9806d870 2024-09-15T22:56:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9815d550 con 0x7f5c9806d870 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c9806dc50 con 0x7f5c9806d870 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c8800bc00 con 0x7f5c9806d870 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 0x7f5c84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5c88086160 con 0x7f5c9806d870 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c97fff640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 0x7f5c84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:39.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.972+0000 7f5c97fff640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 0x7f5c84069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c980b4aa0 tx=0x7f5c8c007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:39.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:39.976+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c88056c90 con 0x7f5c9806d870 2024-09-15T22:56:40.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.180+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c9815d890 con 0x7f5c9806d870 2024-09-15T22:56:40.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.180+0000 7f5c957fa640 1 -- 172.21.15.28:0/3998151494 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f5c88056590 con 0x7f5c9806d870 2024-09-15T22:56:40.183 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 msgr2=0x7f5c84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 0x7f5c84069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c980b4aa0 tx=0x7f5c8c007d50 comp rx=0 tx=0).stop 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 msgr2=0x7f5c9815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d800 tx=0x7f5c8800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 shutdown_connections 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5c9815e820 0x7f5c98153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5c840678c0 0x7f5c84069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c980b3610 0x7f5c98152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 --2- 172.21.15.28:0/3998151494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c9806d870 0x7f5c9815de90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:40.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 >> 172.21.15.28:0/3998151494 conn(0x7f5c980d4910 msgr2=0x7f5c980b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:40.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 shutdown_connections 2024-09-15T22:56:40.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40.184+0000 7f5c9ed3b640 1 -- 172.21.15.28:0/3998151494 wait complete. 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:40.203 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:56:40.204 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:56:40.204 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:56:40.204 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:56:40.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.204 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:56:40.209 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:40.209 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:40.209 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:56:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42456sec preferred_lft 42456sec 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:56:40.211 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.212 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:56:40.266 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:56:40.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.267 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:56:40.314 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:56:40.315 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:40.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:40.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:40.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.444 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:56:40.449 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:56:40.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.450 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-09-15T22:56:40.501 INFO:teuthology.orchestra.run.smithi028.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T22:56:40.501 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:40.501 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:40.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:40.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-15T22:56:40.501 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:40.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:40.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:40.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 62:e5:ff:49:78:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::60e5:ffff:fe49:7817/64 scope link 2024-09-15T22:56:40.633 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:40.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:56:40.686 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 62:e5:ff:49:78:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:56:40.687 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.688 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::60e5:ffff:fe49:7817/64 scope link 2024-09-15T22:56:40.688 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:40.689 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-15T22:56:40.689 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:40.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:40.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:40.831 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:40.832 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:56:40.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.1 up 2024-09-15T22:56:40.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:56:40.832 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:56:40.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:40.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:40.892 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-15T22:56:40.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:40.892 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:40.941 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:56:40.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:40.941 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:40.989 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:41.047 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:41.094 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:41.094 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:41.094 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:41.094 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:41.095 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:41.096 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:41.097 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:41.097 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:41.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:41.098 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:41.145 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:56:41.146 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-15T22:56:41.146 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-15T22:56:41.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:41.206 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:41.253 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:41.254 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:41.255 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:41.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:41.256 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:41.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi028.stderr:2024-09-15T22:56:41.272+0000 7f286d3f3580 -1 init, newargv = 0x5616b6de0240 newargc=15 2024-09-15T22:56:41.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi028.stderr:ceph-fuse[35912]: starting ceph client 2024-09-15T22:56:41.278 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:56:41.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi028.stderr:ceph-fuse[35912]: starting fuse 2024-09-15T22:56:42.379 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:56:42.395 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:56:42.444 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:56:42.445 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:56:42.446 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:42.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:42.447 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:56:42.493 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:56:42.493 INFO:teuthology.orchestra.run.smithi028.stdout:46 2024-09-15T22:56:42.493 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-15T22:56:42.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-15T22:56:42.494 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:56:42.495 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:56:42.496 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.2")) 2024-09-15T22:56:42.496 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:56:42.620 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.2.35912.asok 2024-09-15T22:56:42.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:42.632 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35912.asok 2024-09-15T22:56:42.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:42.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35912.asok status 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "2", 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-15T22:56:42.797 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "35912", 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4614, 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 4614 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.2:0", 2024-09-15T22:56:42.798 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2562887573 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.2:0", 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2562887573 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.4614 192.168.0.2:0/2562887573", 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.2:0/2562887573", 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 7, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 20, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:56:42.799 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:56:42.800 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:56:42.800 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:56:42.812 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T22:56:42.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:56:42.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 Processor -- start 2024-09-15T22:56:42.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 -- start start 2024-09-15T22:56:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3da00b5200 0x7f3da015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 0x7f3da00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da00b55e0 con 0x7f3da00b1dc0 2024-09-15T22:56:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3da00ce3b0 con 0x7f3da00b5200 2024-09-15T22:56:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3da605c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3da015c5f0 con 0x7f3da00cca90 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3da00b5200 0x7f3da015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9effd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 0x7f3da00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9ffff640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3da00b1dc0 0x7f3da00b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:48412/0 (socket says 172.21.15.28:48412) 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9ffff640 1 -- 172.21.15.28:0/3296959829 learned_addr learned my addr 172.21.15.28:0/3296959829 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9e7fc640 1 -- 172.21.15.28:0/3296959829 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730962981 0 0) 0x7f3da00b55e0 con 0x7f3da00b1dc0 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9e7fc640 1 -- 172.21.15.28:0/3296959829 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d88003530 con 0x7f3da00b1dc0 2024-09-15T22:56:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9effd640 1 -- 172.21.15.28:0/3296959829 >> v2:172.21.15.131:3300/0 conn(0x7f3da00b5200 msgr2=0x7f3da015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:42.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9effd640 1 --2- 172.21.15.28:0/3296959829 >> v2:172.21.15.131:3300/0 conn(0x7f3da00b5200 0x7f3da015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:42.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9effd640 1 -- 172.21.15.28:0/3296959829 >> v1:172.21.15.131:6789/0 conn(0x7f3da00b1dc0 legacy=0x7f3da00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:42.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.940+0000 7f3d9effd640 1 -- 172.21.15.28:0/3296959829 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da00b4910 con 0x7f3da00cca90 2024-09-15T22:56:42.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3d9effd640 1 --2- 172.21.15.28:0/3296959829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 0x7f3da00b43d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d940097c0 tx=0x7f3d9401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a518adc7604a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:42.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3d9e7fc640 1 -- 172.21.15.28:0/3296959829 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940b0070 con 0x7f3da00cca90 2024-09-15T22:56:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3d9e7fc640 1 -- 172.21.15.28:0/3296959829 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d940ab600 con 0x7f3da00cca90 2024-09-15T22:56:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3d9e7fc640 1 -- 172.21.15.28:0/3296959829 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940ab9d0 con 0x7f3da00cca90 2024-09-15T22:56:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- 172.21.15.28:0/3296959829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 msgr2=0x7f3da00b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 --2- 172.21.15.28:0/3296959829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 0x7f3da00b43d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d940097c0 tx=0x7f3d9401c410 comp rx=0 tx=0).stop 2024-09-15T22:56:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- 172.21.15.28:0/3296959829 shutdown_connections 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 --2- 172.21.15.28:0/3296959829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00cca90 0x7f3da00b43d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 --2- 172.21.15.28:0/3296959829 >> v2:172.21.15.131:3300/0 conn(0x7f3da00b5200 0x7f3da015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- 172.21.15.28:0/3296959829 >> 172.21.15.28:0/3296959829 conn(0x7f3da006bcc0 msgr2=0x7f3da006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- 172.21.15.28:0/3296959829 shutdown_connections 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- 172.21.15.28:0/3296959829 wait complete. 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 Processor -- start 2024-09-15T22:56:42.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.944+0000 7f3da605c640 1 -- start start 2024-09-15T22:56:42.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00b1dc0 0x7f3da0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00cca90 0x7f3da0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3da00b4070 con 0x7f3da00b5200 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3da00cd8c0 con 0x7f3da00cca90 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3da00b25e0 con 0x7f3da00b1dc0 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35936/0 (socket says 172.21.15.28:35936) 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 -- 172.21.15.28:0/203556172 learned_addr learned my addr 172.21.15.28:0/203556172 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9ffff640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00cca90 0x7f3da0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9f7fe640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00b1dc0 0x7f3da0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 -- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00b1dc0 msgr2=0x7f3da0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00b1dc0 0x7f3da0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:42.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 -- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00cca90 msgr2=0x7f3da0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00cca90 0x7f3da0159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 -- 172.21.15.28:0/203556172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da0157c90 con 0x7f3da00b5200 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9effd640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d9401a040 tx=0x7f3d940191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940ba020 con 0x7f3da00b5200 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d940b5460 con 0x7f3da00b5200 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da0072a80 con 0x7f3da00b5200 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940b0040 con 0x7f3da00b5200 2024-09-15T22:56:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da0157360 con 0x7f3da00b5200 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da015c0b0 con 0x7f3da00b5200 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d940bd020 con 0x7f3da00b5200 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 0x7f3d8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3d9411ffb0 con 0x7f3da00b5200 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9f7fe640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 0x7f3d8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.948+0000 7f3d9f7fe640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 0x7f3d8c069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009af0 tx=0x7f3d90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:42.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:42.952+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d940c4030 con 0x7f3da00b5200 2024-09-15T22:56:43.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.152+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3da0164190 con 0x7f3da00b5200 2024-09-15T22:56:43.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.152+0000 7f3d87fff640 1 -- 172.21.15.28:0/203556172 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f3d94016090 con 0x7f3da00b5200 2024-09-15T22:56:43.155 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 msgr2=0x7f3d8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 0x7f3d8c069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009af0 tx=0x7f3d90008040 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 msgr2=0x7f3da01590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d9401a040 tx=0x7f3d940191b0 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 shutdown_connections 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3d8c0678c0 0x7f3d8c069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00cca90 0x7f3da0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3da00b5200 0x7f3da01590a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 --2- 172.21.15.28:0/203556172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3da00b1dc0 0x7f3da0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:43.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 >> 172.21.15.28:0/203556172 conn(0x7f3da006bcc0 msgr2=0x7f3da01663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:43.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 shutdown_connections 2024-09-15T22:56:43.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:43.156+0000 7f3da605c640 1 -- 172.21.15.28:0/203556172 wait complete. 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:56:43.172 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:56:43.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:43.173 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-09-15T22:56:43.179 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:43.179 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:43.180 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:42:35:ed:46:50 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:56:43.181 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:43.181 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:56:43.181 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:56:43.182 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:43.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:43.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:43.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:43.312 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:56:43.321 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-15T22:56:43.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:43.323 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:43.388 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:56:43.389 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:43.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:43.507 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:43.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:43.514 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-15T22:56:43.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:43.520 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-09-15T22:56:43.569 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:43.569 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:43.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:43.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-15T22:56:43.569 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:43.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:43.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:43.686 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-15T22:56:43.686 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T22:56:43.687 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:43.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:43.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:43.789 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:43.789 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:43.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-09-15T22:56:43.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:56:43.789 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:43.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:43.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:43.895 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T22:56:43.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:43.895 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:43.945 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:56:43.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:43.945 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:43.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:44.050 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:44.097 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:44.098 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:44.099 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:44.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:44.100 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:44.153 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:56:44.153 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T22:56:44.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:44.210 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:44.257 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:44.258 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:44.259 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:44.260 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:44.260 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:44.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:44.260 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:44.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:2024-09-15T22:56:44.269+0000 7f0f74208580 -1 init, newargv = 0x55df65088f10 newargc=15 2024-09-15T22:56:44.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:ceph-fuse[34867]: starting ceph client 2024-09-15T22:56:44.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi131.stderr:ceph-fuse[34867]: starting fuse 2024-09-15T22:56:45.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:56:45.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:56:45.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:45.397 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:45.449 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:45.450 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:45.452 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:45.452 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:45.452 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:45.452 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:45.452 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:45.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:45.453 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:45.500 INFO:teuthology.orchestra.run.smithi131.stdout:45 2024-09-15T22:56:45.500 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T22:56:45.501 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:45.502 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.1")) 2024-09-15T22:56:45.503 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-09-15T22:56:45.626 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.1.34867.asok 2024-09-15T22:56:45.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:45.637 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34867.asok 2024-09-15T22:56:45.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:45.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34867.asok status 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "1", 2024-09-15T22:56:45.791 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "34867", 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-09-15T22:56:45.792 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4564, 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4564 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:45.793 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2645647230 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-15T22:56:45.794 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-15T22:56:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:56:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2645647230 2024-09-15T22:56:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4564 192.168.0.1:0/2645647230", 2024-09-15T22:56:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/2645647230", 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 7, 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 20, 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-09-15T22:56:45.796 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-15T22:56:45.804 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T22:56:45.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:56:45.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 Processor -- start 2024-09-15T22:56:45.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 -- start start 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0724145970 0x7f07240b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07240d0960 con 0x7f07240d0360 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07240d0c40 con 0x7f07240b2300 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072bd3c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f07240b2770 con 0x7f0724145970 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072a2d9640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f07240d0360 0x7f07240cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38486/0 (socket says 172.21.15.28:38486) 2024-09-15T22:56:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072a2d9640 1 -- 172.21.15.28:0/1946727256 learned_addr learned my addr 172.21.15.28:0/1946727256 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 --2- 172.21.15.28:0/1946727256 >> v2:172.21.15.131:3300/0 conn(0x7f0724145970 0x7f07240b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046183175 0 0) 0x7f07240d0960 con 0x7f07240d0360 2024-09-15T22:56:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0710003530 con 0x7f07240d0360 2024-09-15T22:56:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1158464438 0 0) 0x7f0710003530 con 0x7f07240d0360 2024-09-15T22:56:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 >> v2:172.21.15.131:3300/0 conn(0x7f0724145970 msgr2=0x7f07240b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 --2- 172.21.15.28:0/1946727256 >> v2:172.21.15.131:3300/0 conn(0x7f0724145970 0x7f07240b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 >> v1:172.21.15.131:6789/0 conn(0x7f07240b2300 legacy=0x7f07240cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07240cd2b0 con 0x7f07240d0360 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f071c001a00 con 0x7f07240d0360 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 >> v1:172.21.15.28:6789/0 conn(0x7f07240d0360 legacy=0x7f07240cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f0710003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0710004810 0x7f0710004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07100051d0 0x7f071000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07240b2770 con 0x7f07100039c0 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f071000c170 con 0x7f0710004810 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f071000c370 con 0x7f07100051d0 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f0710003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f07292d7640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0710004810 0x7f0710004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072a2d9640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07100051d0 0x7f071000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 -- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07100051d0 msgr2=0x7f071000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07100051d0 0x7f071000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 -- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0710004810 msgr2=0x7f0710004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0710004810 0x7f0710004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f0729ad8640 1 -- 172.21.15.28:0/1946727256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710003530 con 0x7f07100039c0 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072a2d9640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07100051d0 0x7f071000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.940+0000 7f072a2d9640 1 -- 172.21.15.28:0/1946727256 reap_dead start 2024-09-15T22:56:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f0729ad8640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f0710003de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0714009ae0 tx=0x7f071401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8081dfd19b49037 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:45.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140b2070 con 0x7f07100039c0 2024-09-15T22:56:45.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07140a5550 con 0x7f07100039c0 2024-09-15T22:56:45.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f0728ad6640 1 -- 172.21.15.28:0/1946727256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140096b0 con 0x7f07100039c0 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 -- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 msgr2=0x7f0710003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f0710003de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0714009ae0 tx=0x7f071401ca70 comp rx=0 tx=0).stop 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 -- 172.21.15.28:0/1946727256 shutdown_connections 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 --2- 172.21.15.28:0/1946727256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f0710003de0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 -- 172.21.15.28:0/1946727256 >> 172.21.15.28:0/1946727256 conn(0x7f072406bcc0 msgr2=0x7f072406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 -- 172.21.15.28:0/1946727256 shutdown_connections 2024-09-15T22:56:45.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.944+0000 7f072bd3c640 1 -- 172.21.15.28:0/1946727256 wait complete. 2024-09-15T22:56:45.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 Processor -- start 2024-09-15T22:56:45.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- start start 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07241f6540 0x7f07241e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 0x7f072415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0724072d80 con 0x7f07100039c0 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0724072c00 con 0x7f07241f6540 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0724072f00 con 0x7f07241419a0 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35960/0 (socket says 172.21.15.28:35960) 2024-09-15T22:56:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 -- 172.21.15.28:0/2542780394 learned_addr learned my addr 172.21.15.28:0/2542780394 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f07292d7640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07241f6540 0x7f07241e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072a2d9640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 0x7f072415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 -- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 msgr2=0x7f072415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 0x7f072415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 -- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07241f6540 msgr2=0x7f07241e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07241f6540 0x7f07241e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 -- 172.21.15.28:0/2542780394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07241ea380 con 0x7f07100039c0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072a2d9640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 0x7f072415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f0729ad8640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0714009ae0 tx=0x7f0710005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140bc030 con 0x7f07100039c0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071400f000 con 0x7f07100039c0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07241ea660 con 0x7f07100039c0 2024-09-15T22:56:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140b2040 con 0x7f07100039c0 2024-09-15T22:56:45.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07240aa640 con 0x7f07100039c0 2024-09-15T22:56:45.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07241eab80 con 0x7f07100039c0 2024-09-15T22:56:45.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.948+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07140bf070 con 0x7f07100039c0 2024-09-15T22:56:45.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.952+0000 7f071a7fc640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:45.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.952+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f071411f4c0 con 0x7f07100039c0 2024-09-15T22:56:45.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.952+0000 7f07292d7640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:45.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.952+0000 7f07292d7640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 0x7f0708069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072415e140 tx=0x7f0720009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:45.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:45.956+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07241eab80 con 0x7f07100039c0 2024-09-15T22:56:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.156+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07240cda90 con 0x7f07100039c0 2024-09-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.156+0000 7f071a7fc640 1 -- 172.21.15.28:0/2542780394 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f0714016780 con 0x7f07100039c0 2024-09-15T22:56:46.159 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:56:46.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 msgr2=0x7f0708069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 0x7f0708069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072415e140 tx=0x7f0720009040 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 msgr2=0x7f07240abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0714009ae0 tx=0x7f0710005840 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 shutdown_connections 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07241419a0 0x7f072415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07241f6540 0x7f07241e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 --2- 172.21.15.28:0/2542780394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07100039c0 0x7f07240abc40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 >> 172.21.15.28:0/2542780394 conn(0x7f072406bcc0 msgr2=0x7f07240b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 shutdown_connections 2024-09-15T22:56:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:46.160+0000 7f072bd3c640 1 -- 172.21.15.28:0/2542780394 wait complete. 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:56:46.178 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:56:46.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.179 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:56:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 02:42:35:ed:46:50 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:56:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.189 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:56:46.239 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-15T22:56:46.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.241 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-09-15T22:56:46.293 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:56:46.294 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:56:46.295 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:46.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:46.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.419 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-15T22:56:46.424 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:56:46.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.424 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-09-15T22:56:46.472 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-15T22:56:46.472 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:46.472 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:46.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:46.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-15T22:56:46.472 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:46.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:46.579 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:46.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:56:46.597 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 72:e0:f2:13:f3:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::70e0:f2ff:fe13:f328/64 scope link 2024-09-15T22:56:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:46.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:56:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 72:e0:f2:13:f3:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::70e0:f2ff:fe13:f328/64 scope link 2024-09-15T22:56:46.655 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:56:46.656 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-15T22:56:46.656 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:46.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:46.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:46.797 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:56:46.797 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-15T22:56:46.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2024-09-15T22:56:46.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:56:46.797 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-15T22:56:46.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:56:46.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:46.856 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-15T22:56:46.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:46.856 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:46.904 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:56:46.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:56:46.904 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:46.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:47.009 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:47.058 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:47.059 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:47.060 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:47.061 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:47.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:47.062 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:47.108 INFO:teuthology.orchestra.run.smithi131.stdout:45 2024-09-15T22:56:47.108 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-15T22:56:47.108 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-15T22:56:47.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:47.166 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:47.213 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:47.213 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:47.213 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:47.213 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:47.214 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:47.215 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:47.216 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:47.216 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:47.216 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:47.216 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:47.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:47.216 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:47.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:2024-09-15T22:56:47.225+0000 7fcc0e33d580 -1 init, newargv = 0x5653856dc0d0 newargc=15 2024-09-15T22:56:47.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:ceph-fuse[34988]: starting ceph client 2024-09-15T22:56:47.234 INFO:teuthology.orchestra.run.smithi131.stdout:45 2024-09-15T22:56:47.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi131.stderr:ceph-fuse[34988]: starting fuse 2024-09-15T22:56:48.335 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-09-15T22:56:48.351 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:56:48.401 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-09-15T22:56:48.401 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/run/lock 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-09-15T22:56:48.402 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/fs/nfsd 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/rpc_pipefs 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:48.403 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:56:48.404 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:48.404 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:48.404 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:56:48.404 INFO:teuthology.orchestra.run.smithi131.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:48.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.405 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-09-15T22:56:48.452 INFO:teuthology.orchestra.run.smithi131.stdout:45 2024-09-15T22:56:48.452 INFO:teuthology.orchestra.run.smithi131.stdout:46 2024-09-15T22:56:48.453 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:48.453 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> 2024-09-15T22:56:48.454 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.3")) 2024-09-15T22:56:48.455 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-09-15T22:56:48.577 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.3.34988.asok 2024-09-15T22:56:48.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-15T22:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:56:48.589 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34988.asok 2024-09-15T22:56:48.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34988.asok status 2024-09-15T22:56:48.741 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "3", 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-09-15T22:56:48.742 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "34988", 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-09-15T22:56:48.743 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4463, 2024-09-15T22:56:48.744 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-09-15T22:56:48.744 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-09-15T22:56:48.744 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-09-15T22:56:48.744 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4463 2024-09-15T22:56:48.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 467378645 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-09-15T22:56:48.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.2:0", 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 467378645 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4463 192.168.0.2:0/467378645", 2024-09-15T22:56:48.746 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.2:0/467378645", 2024-09-15T22:56:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-09-15T22:56:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 7, 2024-09-15T22:56:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 20, 2024-09-15T22:56:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:56:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-09-15T22:56:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-09-15T22:56:48.748 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-15T22:56:48.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.755 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:56:48.755 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:48.763 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:56:48.763 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:48.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.763 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:48.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.822 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:56:48.822 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:48.871 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:56:48.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:48.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:48.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.931 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-09-15T22:56:48.931 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-09-15T22:56:48.939 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:48.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:48.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:48.994 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-09-15T22:56:48.994 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:49.041 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-09-15T22:56:49.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:49.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:49.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:49.100 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T22:56:49.143 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-09-15T22:56:49.143 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-09-15T22:56:49.143 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:49.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 Processor -- start 2024-09-15T22:56:49.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 -- start start 2024-09-15T22:56:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe26815b0a0 0x7fe26806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe26806d310 0x7fe2680cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2680d0000 con 0x7fe2680cfb90 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe26806d750 con 0x7fe26815b0a0 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe2707b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2680d0290 con 0x7fe26806d310 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26e552640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe26815b0a0 0x7fe26806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26ed53640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe2680cfb90 0x7fe2680cb720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38496/0 (socket says 172.21.15.28:38496) 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26ed53640 1 -- 172.21.15.28:0/558025528 learned_addr learned my addr 172.21.15.28:0/558025528 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26dd51640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe26806d310 0x7fe2680cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26e552640 1 -- 172.21.15.28:0/558025528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe26806d310 msgr2=0x7fe2680cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26e552640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe26806d310 0x7fe2680cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26e552640 1 -- 172.21.15.28:0/558025528 >> v1:172.21.15.28:6789/0 conn(0x7fe2680cfb90 legacy=0x7fe2680cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26d550640 1 -- 172.21.15.28:0/558025528 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935409722 0 0) 0x7fe2680d0000 con 0x7fe2680cfb90 2024-09-15T22:56:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.280+0000 7fe26e552640 1 -- 172.21.15.28:0/558025528 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe268071d30 con 0x7fe26815b0a0 2024-09-15T22:56:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26e552640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe26806cdd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2640097c0 tx=0x7fe26401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166d902a0c7182cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26d550640 1 -- 172.21.15.28:0/558025528 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2640ab610 con 0x7fe26815b0a0 2024-09-15T22:56:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26d550640 1 -- 172.21.15.28:0/558025528 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2640b0070 con 0x7fe26815b0a0 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26d550640 1 -- 172.21.15.28:0/558025528 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2640ab9d0 con 0x7fe26815b0a0 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- 172.21.15.28:0/558025528 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 msgr2=0x7fe26806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe26806cdd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2640097c0 tx=0x7fe26401c410 comp rx=0 tx=0).stop 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- 172.21.15.28:0/558025528 shutdown_connections 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe26806d310 0x7fe2680cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- 172.21.15.28:0/558025528 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe26806cdd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- 172.21.15.28:0/558025528 >> 172.21.15.28:0/558025528 conn(0x7fe2680cdbe0 msgr2=0x7fe2680cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- 172.21.15.28:0/558025528 shutdown_connections 2024-09-15T22:56:49.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- 172.21.15.28:0/558025528 wait complete. 2024-09-15T22:56:49.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 Processor -- start 2024-09-15T22:56:49.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- start start 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 0x7fe2681f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2680cfb90 0x7fe26814c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe26815b600 con 0x7fe26815b0a0 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe26815b480 con 0x7fe26806d310 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe2707b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe268167d50 con 0x7fe2680cfb90 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35984/0 (socket says 172.21.15.28:35984) 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 -- 172.21.15.28:0/261752947 learned_addr learned my addr 172.21.15.28:0/261752947 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26e552640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 0x7fe2681f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26dd51640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2680cfb90 0x7fe26814c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 -- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2680cfb90 msgr2=0x7fe26814c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2680cfb90 0x7fe26814c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 -- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 msgr2=0x7fe2681f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 0x7fe2681f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26ed53640 1 -- 172.21.15.28:0/261752947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26814d190 con 0x7fe26815b0a0 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.284+0000 7fe26e552640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 0x7fe2681f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe26ed53640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe26000c7a0 tx=0x7fe26000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260018070 con 0x7fe26815b0a0 2024-09-15T22:56:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe26000a640 con 0x7fe26815b0a0 2024-09-15T22:56:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26815cb70 con 0x7fe26815b0a0 2024-09-15T22:56:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26000aab0 con 0x7fe26815b0a0 2024-09-15T22:56:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26815d410 con 0x7fe26815b0a0 2024-09-15T22:56:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26815d900 con 0x7fe26815b0a0 2024-09-15T22:56:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe26001b070 con 0x7fe26815b0a0 2024-09-15T22:56:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 0x7fe24c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe26e552640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 0x7fe24c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2600851d0 con 0x7fe26815b0a0 2024-09-15T22:56:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.288+0000 7fe26e552640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 0x7fe24c069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2640af000 tx=0x7fe2640a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.292+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe260055da0 con 0x7fe26815b0a0 2024-09-15T22:56:49.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.456+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2680cf630 con 0x7fe26815b0a0 2024-09-15T22:56:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe25effd640 1 -- 172.21.15.28:0/261752947 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7fe2600556a0 con 0x7fe26815b0a0 2024-09-15T22:56:49.462 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:49.462 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:49.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 msgr2=0x7fe24c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 0x7fe24c069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2640af000 tx=0x7fe2640a7000 comp rx=0 tx=0).stop 2024-09-15T22:56:49.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 msgr2=0x7fe2680b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe26000c7a0 tx=0x7fe26000cc60 comp rx=0 tx=0).stop 2024-09-15T22:56:49.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 shutdown_connections 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe26815b0a0 0x7fe2680b4b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2680cfb90 0x7fe26814c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe24c0678c0 0x7fe24c069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 --2- 172.21.15.28:0/261752947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe26806d310 0x7fe2681f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.460+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 >> 172.21.15.28:0/261752947 conn(0x7fe2680cdbe0 msgr2=0x7fe268157500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.464+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 shutdown_connections 2024-09-15T22:56:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.464+0000 7fe2707b6640 1 -- 172.21.15.28:0/261752947 wait complete. 2024-09-15T22:56:49.481 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:56:09.941276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:56:18.586931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:56:19.343111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:56:49.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:56:49.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 Processor -- start 2024-09-15T22:56:49.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 -- start start 2024-09-15T22:56:49.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e0072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32e0072860 0x7f32e00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e0073a40 con 0x7f32e00b2370 2024-09-15T22:56:49.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f32e0072ca0 con 0x7f32e0072860 2024-09-15T22:56:49.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32e4e73640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f32e00b27e0 con 0x7f32e0145b20 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32de59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e0072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32ddd9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32e0072860 0x7f32e00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32ddd9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32e0072860 0x7f32e00b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:40134/0 (socket says 172.21.15.28:40134) 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.608+0000 7f32ddd9b640 1 -- 172.21.15.28:0/535495863 learned_addr learned my addr 172.21.15.28:0/535495863 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32ddd9b640 1 -- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 msgr2=0x7f32e0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32ddd9b640 1 --2- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e0072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32ddd9b640 1 -- 172.21.15.28:0/535495863 >> v1:172.21.15.131:6789/0 conn(0x7f32e00b2370 legacy=0x7f32e015ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32ddd9b640 1 -- 172.21.15.28:0/535495863 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e0072ec0 con 0x7f32e0072860 2024-09-15T22:56:49.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32ddd9b640 1 --2- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e00b1e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e50 tx=0x7f32c801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4a90e1fdb1b8dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32dd59a640 1 -- 172.21.15.28:0/535495863 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80a5830 con 0x7f32e0072860 2024-09-15T22:56:49.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32dd59a640 1 -- 172.21.15.28:0/535495863 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c80a59d0 con 0x7f32e0072860 2024-09-15T22:56:49.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32dd59a640 1 -- 172.21.15.28:0/535495863 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80a5da0 con 0x7f32e0072860 2024-09-15T22:56:49.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 -- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 msgr2=0x7f32e00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 --2- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e00b1e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009e50 tx=0x7f32c801c970 comp rx=0 tx=0).stop 2024-09-15T22:56:49.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 -- 172.21.15.28:0/535495863 shutdown_connections 2024-09-15T22:56:49.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 --2- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e00b1e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 --2- 172.21.15.28:0/535495863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e0072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 -- 172.21.15.28:0/535495863 >> 172.21.15.28:0/535495863 conn(0x7f32e006bcc0 msgr2=0x7f32e006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:49.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 -- 172.21.15.28:0/535495863 shutdown_connections 2024-09-15T22:56:49.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.612+0000 7f32e4e73640 1 -- 172.21.15.28:0/535495863 wait complete. 2024-09-15T22:56:49.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 Processor -- start 2024-09-15T22:56:49.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- start start 2024-09-15T22:56:49.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e013baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f32e0145f00 con 0x7f32e00b2370 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00ccda0 con 0x7f32e0072860 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f32e0146080 con 0x7f32e0145b20 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35996/0 (socket says 172.21.15.28:35996) 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 -- 172.21.15.28:0/3543737487 learned_addr learned my addr 172.21.15.28:0/3543737487 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32de59c640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e013baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ded9d640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 -- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 msgr2=0x7f32e013fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e013fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 -- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 msgr2=0x7f32e013baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e013baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 -- 172.21.15.28:0/3543737487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e0144a90 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ded9d640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32ddd9b640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32c801a5a0 tx=0x7f32c8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80bc020 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c80b8670 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e013d070 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80b8a40 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e013d630 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.616+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e0069220 con 0x7f32e00b2370 2024-09-15T22:56:49.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.620+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32c80bf020 con 0x7f32e00b2370 2024-09-15T22:56:49.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.620+0000 7f32d6ffd640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.620+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f32c8120db0 con 0x7f32e00b2370 2024-09-15T22:56:49.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.620+0000 7f32de59c640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.620+0000 7f32de59c640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 0x7f32c0069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f32e01f8cd0 tx=0x7f32d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.624+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32c8125070 con 0x7f32e00b2370 2024-09-15T22:56:49.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.784+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32e00b1e30 con 0x7f32e00b2370 2024-09-15T22:56:49.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.784+0000 7f32d6ffd640 1 -- 172.21.15.28:0/3543737487 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f32c80c6030 con 0x7f32e00b2370 2024-09-15T22:56:49.788 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 msgr2=0x7f32c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 0x7f32c0069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f32e01f8cd0 tx=0x7f32d0008040 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 msgr2=0x7f32e0144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32c801a5a0 tx=0x7f32c8019710 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 shutdown_connections 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32e0145b20 0x7f32e013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32e00b2370 0x7f32e0144040 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f32c00678c0 0x7f32c0069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 --2- 172.21.15.28:0/3543737487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32e0072860 0x7f32e013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 >> 172.21.15.28:0/3543737487 conn(0x7f32e006bcc0 msgr2=0x7f32e01564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 shutdown_connections 2024-09-15T22:56:49.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.788+0000 7f32e4e73640 1 -- 172.21.15.28:0/3543737487 wait complete. 2024-09-15T22:56:49.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:56:49.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 Processor -- start 2024-09-15T22:56:49.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 -- start start 2024-09-15T22:56:49.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f8072a30 0x7f28f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f28f80b2370 0x7f28f80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f8073a40 con 0x7f28f8145b20 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f28f80b27c0 con 0x7f28f80b2370 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28fda65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f28f8072ec0 con 0x7f28f8072a30 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f28f80b2370 0x7f28f80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f28f8145b20 0x7f28f8072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38498/0 (socket says 172.21.15.28:38498) 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f77fe640 1 -- 172.21.15.28:0/1522331921 learned_addr learned my addr 172.21.15.28:0/1522331921 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f6ffd640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f8072a30 0x7f28f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f7fff640 1 -- 172.21.15.28:0/1522331921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f8072a30 msgr2=0x7f28f80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f7fff640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f8072a30 0x7f28f80b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f7fff640 1 -- 172.21.15.28:0/1522331921 >> v1:172.21.15.28:6789/0 conn(0x7f28f8145b20 legacy=0x7f28f8072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f7fff640 1 -- 172.21.15.28:0/1522331921 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f80731a0 con 0x7f28f80b2370 2024-09-15T22:56:49.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.936+0000 7f28f67fc640 1 -- 172.21.15.28:0/1522331921 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611388330 0 0) 0x7f28f8073a40 con 0x7f28f8145b20 2024-09-15T22:56:49.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f7fff640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f80b2370 0x7f28f80cf720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009d90 tx=0x7f28f001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd2d100ffe55420 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f67fc640 1 -- 172.21.15.28:0/1522331921 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00b2070 con 0x7f28f80b2370 2024-09-15T22:56:49.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f67fc640 1 -- 172.21.15.28:0/1522331921 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f00a5970 con 0x7f28f80b2370 2024-09-15T22:56:49.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f67fc640 1 -- 172.21.15.28:0/1522331921 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00a5d40 con 0x7f28f80b2370 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- 172.21.15.28:0/1522331921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f80b2370 msgr2=0x7f28f80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f80b2370 0x7f28f80cf720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009d90 tx=0x7f28f001c8b0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- 172.21.15.28:0/1522331921 shutdown_connections 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f80b2370 0x7f28f80cf720 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- 172.21.15.28:0/1522331921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f8072a30 0x7f28f80b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- 172.21.15.28:0/1522331921 >> 172.21.15.28:0/1522331921 conn(0x7f28f806bcc0 msgr2=0x7f28f806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:49.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- 172.21.15.28:0/1522331921 shutdown_connections 2024-09-15T22:56:49.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- 172.21.15.28:0/1522331921 wait complete. 2024-09-15T22:56:49.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 Processor -- start 2024-09-15T22:56:49.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- start start 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f80b2370 0x7f28f81ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 0x7f28f813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28f8146080 con 0x7f28f81fb5f0 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f28f8145f00 con 0x7f28f8145b20 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28fda65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f28f80d0470 con 0x7f28f80b2370 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36028/0 (socket says 172.21.15.28:36028) 2024-09-15T22:56:49.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f7fff640 1 -- 172.21.15.28:0/4030745763 learned_addr learned my addr 172.21.15.28:0/4030745763 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f77fe640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f80b2370 0x7f28f81ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.940+0000 7f28f6ffd640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 0x7f28f813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 -- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f80b2370 msgr2=0x7f28f81ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f80b2370 0x7f28f81ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 -- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 msgr2=0x7f28f813eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 0x7f28f813eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 -- 172.21.15.28:0/4030745763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f81ffb90 con 0x7f28f81fb5f0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f6ffd640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 0x7f28f813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f7fff640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28f00b0040 tx=0x7f28f0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00b2050 con 0x7f28f81fb5f0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f00b3040 con 0x7f28f81fb5f0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f81fbb10 con 0x7f28f81fb5f0 2024-09-15T22:56:49.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f00ad850 con 0x7f28f81fb5f0 2024-09-15T22:56:49.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f81fc0d0 con 0x7f28f81fb5f0 2024-09-15T22:56:49.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f8069220 con 0x7f28f81fb5f0 2024-09-15T22:56:49.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28f00c0020 con 0x7f28f81fb5f0 2024-09-15T22:56:49.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 0x7f28e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:49.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f28f01206c0 con 0x7f28f81fb5f0 2024-09-15T22:56:49.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f77fe640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 0x7f28e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:49.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.944+0000 7f28f77fe640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 0x7f28e4069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28e8000f70 tx=0x7f28e8007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:49.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:49.948+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f28f81ffb90 con 0x7f28f81fb5f0 2024-09-15T22:56:50.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.116+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f28f80d0850 con 0x7f28f81fb5f0 2024-09-15T22:56:50.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.116+0000 7f28dffff640 1 -- 172.21.15.28:0/4030745763 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f28f0016560 con 0x7f28f81fb5f0 2024-09-15T22:56:50.119 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 msgr2=0x7f28e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 0x7f28e4069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f28e8000f70 tx=0x7f28e8007c10 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 msgr2=0x7f28f81442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28f00b0040 tx=0x7f28f0019650 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 shutdown_connections 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28f81fb5f0 0x7f28f81442a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f28e40678f0 0x7f28e4069db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28f8145b20 0x7f28f813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 --2- 172.21.15.28:0/4030745763 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28f80b2370 0x7f28f81ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 >> 172.21.15.28:0/4030745763 conn(0x7f28f806bcc0 msgr2=0x7f28f815e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:50.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 shutdown_connections 2024-09-15T22:56:50.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.120+0000 7f28fda65640 1 -- 172.21.15.28:0/4030745763 wait complete. 2024-09-15T22:56:50.140 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:56:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 Processor -- start 2024-09-15T22:56:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 -- start start 2024-09-15T22:56:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 0x7f356c072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f356c072860 0x7f356c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c0b2780 con 0x7f356c0b2370 2024-09-15T22:56:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f356c073a40 con 0x7f356c072860 2024-09-15T22:56:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3570c71640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f356c072ec0 con 0x7f356c145b20 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f356c072860 0x7f356c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f356c072860 0x7f356c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36030/0 (socket says 172.21.15.28:36030) 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 -- 172.21.15.28:0/680783143 learned_addr learned my addr 172.21.15.28:0/680783143 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f356a59c640 1 --2- 172.21.15.28:0/680783143 >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 0x7f356c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 -- 172.21.15.28:0/680783143 >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 msgr2=0x7f356c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 --2- 172.21.15.28:0/680783143 >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 0x7f356c072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 -- 172.21.15.28:0/680783143 >> v1:172.21.15.131:6789/0 conn(0x7f356c0b2370 legacy=0x7f356c15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f3569d9b640 1 -- 172.21.15.28:0/680783143 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c0731a0 con 0x7f356c072860 2024-09-15T22:56:50.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.260+0000 7f356a59c640 1 --2- 172.21.15.28:0/680783143 >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 0x7f356c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:50.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3569d9b640 1 --2- 172.21.15.28:0/680783143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c072860 0x7f356c0b1e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f356c146240 tx=0x7f356001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269d5c5f2fc1fb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f356959a640 1 -- 172.21.15.28:0/680783143 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600b2070 con 0x7f356c072860 2024-09-15T22:56:50.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f356959a640 1 -- 172.21.15.28:0/680783143 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35600ad680 con 0x7f356c072860 2024-09-15T22:56:50.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f356959a640 1 -- 172.21.15.28:0/680783143 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600ada50 con 0x7f356c072860 2024-09-15T22:56:50.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 -- 172.21.15.28:0/680783143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c072860 msgr2=0x7f356c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 --2- 172.21.15.28:0/680783143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c072860 0x7f356c0b1e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f356c146240 tx=0x7f356001c490 comp rx=0 tx=0).stop 2024-09-15T22:56:50.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 -- 172.21.15.28:0/680783143 shutdown_connections 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 --2- 172.21.15.28:0/680783143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c072860 0x7f356c0b1e30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 --2- 172.21.15.28:0/680783143 >> v2:172.21.15.131:3300/0 conn(0x7f356c145b20 0x7f356c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 -- 172.21.15.28:0/680783143 >> 172.21.15.28:0/680783143 conn(0x7f356c06bcc0 msgr2=0x7f356c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 -- 172.21.15.28:0/680783143 shutdown_connections 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.264+0000 7f3570c71640 1 -- 172.21.15.28:0/680783143 wait complete. 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 Processor -- start 2024-09-15T22:56:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- start start 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f356c072860 0x7f356c13b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 0x7f356c1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f356c146080 con 0x7f356c145b20 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f356c145f00 con 0x7f356c072860 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f356c169330 con 0x7f356c0b2370 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36038/0 (socket says 172.21.15.28:36038) 2024-09-15T22:56:50.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 -- 172.21.15.28:0/1144582734 learned_addr learned my addr 172.21.15.28:0/1144582734 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356a59c640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f356c072860 0x7f356c13b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3569d9b640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 0x7f356c1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 -- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 msgr2=0x7f356c1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 0x7f356c1448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 -- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f356c072860 msgr2=0x7f356c13b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f356c072860 0x7f356c13b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 -- 172.21.15.28:0/1144582734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c13ff50 con 0x7f356c145b20 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3569d9b640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 0x7f356c1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f356ad9d640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f356400c390 tx=0x7f356400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35640052d0 con 0x7f356c145b20 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564005470 con 0x7f356c145b20 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c140230 con 0x7f356c145b20 2024-09-15T22:56:50.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564007240 con 0x7f356c145b20 2024-09-15T22:56:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1f8630 con 0x7f356c145b20 2024-09-15T22:56:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c069220 con 0x7f356c145b20 2024-09-15T22:56:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35640073e0 con 0x7f356c145b20 2024-09-15T22:56:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.268+0000 7f355affd640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.272+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35640850f0 con 0x7f356c145b20 2024-09-15T22:56:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.272+0000 7f356a59c640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.272+0000 7f356a59c640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 0x7f354c069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f355c0099e0 tx=0x7f355c003cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.276+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f356c0b2780 con 0x7f356c145b20 2024-09-15T22:56:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.436+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f356c0b1e30 con 0x7f356c145b20 2024-09-15T22:56:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.436+0000 7f355affd640 1 -- 172.21.15.28:0/1144582734 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f3564055c30 con 0x7f356c145b20 2024-09-15T22:56:50.439 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 msgr2=0x7f354c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 0x7f354c069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f355c0099e0 tx=0x7f355c003cf0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 msgr2=0x7f356c0b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f356400c390 tx=0x7f356400c850 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 shutdown_connections 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f356c145b20 0x7f356c0b3a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f356c0b2370 0x7f356c1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 --2- 172.21.15.28:0/1144582734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f356c072860 0x7f356c13b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 >> 172.21.15.28:0/1144582734 conn(0x7f356c06bcc0 msgr2=0x7f356c0cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 shutdown_connections 2024-09-15T22:56:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.440+0000 7f3570c71640 1 -- 172.21.15.28:0/1144582734 wait complete. 2024-09-15T22:56:50.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-09-15T22:56:50.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 Processor -- start 2024-09-15T22:56:50.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 -- start start 2024-09-15T22:56:50.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e2006d870 0x7f4e2006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 0x7f4e200cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2006e190 con 0x7f4e200b3610 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200d2ba0 con 0x7f4e2006d870 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e252c5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200d2e80 con 0x7f4e2015e820 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e2006d870 0x7f4e2006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4e200b3610 0x7f4e200d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38514/0 (socket says 172.21.15.28:38514) 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1f7fe640 1 -- 172.21.15.28:0/3234339141 learned_addr learned my addr 172.21.15.28:0/3234339141 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e2006d870 0x7f4e2006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36044/0 (socket says 172.21.15.28:36044) 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e167fc640 1 --2- 172.21.15.28:0/3234339141 >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 0x7f4e200cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 -- 172.21.15.28:0/3234339141 >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 msgr2=0x7f4e200cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 --2- 172.21.15.28:0/3234339141 >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 0x7f4e200cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 -- 172.21.15.28:0/3234339141 >> v1:172.21.15.28:6789/0 conn(0x7f4e200b3610 legacy=0x7f4e200d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e1effd640 1 -- 172.21.15.28:0/3234339141 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e200d3160 con 0x7f4e2006d870 2024-09-15T22:56:50.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.568+0000 7f4e167fc640 1 --2- 172.21.15.28:0/3234339141 >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 0x7f4e200cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- 172.21.15.28:0/3234339141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2006dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e2008d8d0 tx=0x7f4e1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57e8b973806ae3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1e7fc640 1 -- 172.21.15.28:0/3234339141 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100ab680 con 0x7f4e2006d870 2024-09-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1e7fc640 1 -- 172.21.15.28:0/3234339141 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100b0070 con 0x7f4e2006d870 2024-09-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1e7fc640 1 -- 172.21.15.28:0/3234339141 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100aba40 con 0x7f4e2006d870 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- 172.21.15.28:0/3234339141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 msgr2=0x7f4e2006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- 172.21.15.28:0/3234339141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2006dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4e2008d8d0 tx=0x7f4e1001c480 comp rx=0 tx=0).stop 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- 172.21.15.28:0/3234339141 shutdown_connections 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- 172.21.15.28:0/3234339141 >> v2:172.21.15.131:3300/0 conn(0x7f4e2015e820 0x7f4e200cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- 172.21.15.28:0/3234339141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2006dc50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- 172.21.15.28:0/3234339141 >> 172.21.15.28:0/3234339141 conn(0x7f4e200d4910 msgr2=0x7f4e200d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- 172.21.15.28:0/3234339141 shutdown_connections 2024-09-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- 172.21.15.28:0/3234339141 wait complete. 2024-09-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 Processor -- start 2024-09-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- start start 2024-09-15T22:56:50.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e200b3610 0x7f4e200cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e2015e820 0x7f4e200b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2016b1a0 con 0x7f4e2006d870 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200d4350 con 0x7f4e2015e820 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e252c5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2016b320 con 0x7f4e200b3610 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36052/0 (socket says 172.21.15.28:36052) 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 -- 172.21.15.28:0/2983353380 learned_addr learned my addr 172.21.15.28:0/2983353380 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 -- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e200b3610 msgr2=0x7f4e200cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e200b3610 0x7f4e200cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 -- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e2015e820 msgr2=0x7f4e200b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1f7fe640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e2015e820 0x7f4e200b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e2015e820 0x7f4e200b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:50.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 -- 172.21.15.28:0/2983353380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2015bfb0 con 0x7f4e2006d870 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e1effd640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e10019090 tx=0x7f4e1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.572+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100b5810 con 0x7f4e2006d870 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100a7070 con 0x7f4e2006d870 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2015ad90 con 0x7f4e2006d870 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100b5c10 con 0x7f4e2006d870 2024-09-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2015b5d0 con 0x7f4e2006d870 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2006dc50 con 0x7f4e2006d870 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e100bd020 con 0x7f4e2006d870 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e17fff640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 0x7f4e00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e10120430 con 0x7f4e2006d870 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e167fc640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 0x7f4e00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:50.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.576+0000 7f4e167fc640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 0x7f4e00069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b8b30 tx=0x7f4e08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:50.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.580+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4e2015ad90 con 0x7f4e2006d870 2024-09-15T22:56:50.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:50.796+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7f4e20069450 con 0x7f4e2006d870 2024-09-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.128+0000 7f4e17fff640 1 -- 172.21.15.28:0/2983353380 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v48) ==== 150+0+0 (secure 0 0 0) 0x7f4e10016070 con 0x7f4e2006d870 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 msgr2=0x7f4e00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 0x7f4e00069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e200b8b30 tx=0x7f4e08008040 comp rx=0 tx=0).stop 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 msgr2=0x7f4e2015a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e10019090 tx=0x7f4e1001acc0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 shutdown_connections 2024-09-15T22:56:51.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f4e000678c0 0x7f4e00069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e2015e820 0x7f4e200b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e200b3610 0x7f4e200cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 --2- 172.21.15.28:0/2983353380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e2006d870 0x7f4e2015a750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 >> 172.21.15.28:0/2983353380 conn(0x7f4e200d4910 msgr2=0x7f4e20074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 shutdown_connections 2024-09-15T22:56:51.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.132+0000 7f4e252c5640 1 -- 172.21.15.28:0/2983353380 wait complete. 2024-09-15T22:56:51.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:56:51.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 Processor -- start 2024-09-15T22:56:51.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 -- start start 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0cc415e620 0x7f0cc40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc40d2cc0 con 0x7f0cc415ea00 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc40d2fa0 con 0x7f0cc40d2830 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc9746640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc40d3280 con 0x7f0cc415e620 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cbbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0cc415ea00 0x7f0cc40b76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38530/0 (socket says 172.21.15.28:38530) 2024-09-15T22:56:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cbbfff640 1 -- 172.21.15.28:0/1867428027 learned_addr learned my addr 172.21.15.28:0/1867428027 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/1867428027 >> v2:172.21.15.131:3300/0 conn(0x7f0cc415e620 0x7f0cc40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943989736 0 0) 0x7f0cc40d2cc0 con 0x7f0cc415ea00 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cb0003530 con 0x7f0cc415ea00 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1400834028 0 0) 0x7f0cb0003530 con 0x7f0cc415ea00 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 >> v2:172.21.15.131:3300/0 conn(0x7f0cc415e620 msgr2=0x7f0cc40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 --2- 172.21.15.28:0/1867428027 >> v2:172.21.15.131:3300/0 conn(0x7f0cc415e620 0x7f0cc40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 >> v1:172.21.15.131:6789/0 conn(0x7f0cc40d2830 legacy=0x7f0cc40d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc40d3560 con 0x7f0cc415ea00 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f0cac001680 con 0x7f0cc415ea00 2024-09-15T22:56:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 >> v1:172.21.15.28:6789/0 conn(0x7f0cc415ea00 legacy=0x7f0cc40b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cb00039c0 0x7f0cb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb0004810 0x7f0cb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc40d3280 con 0x7f0cb00051d0 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb000c070 con 0x7f0cb0004810 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb000c270 con 0x7f0cb00039c0 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cbbfff640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb0004810 0x7f0cb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cb00039c0 0x7f0cb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 -- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cb00039c0 msgr2=0x7f0cb0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cb00039c0 0x7f0cb0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 -- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb0004810 msgr2=0x7f0cb0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb0004810 0x7f0cb0004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc37fe640 1 -- 172.21.15.28:0/1867428027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb0003530 con 0x7f0cb00051d0 2024-09-15T22:56:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.284+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cb00039c0 0x7f0cb0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc37fe640 1 -- 172.21.15.28:0/1867428027 reap_dead start 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc37fe640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cb000b9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001e70 tx=0x7f0cbc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5676b91abf0bb218 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc001a90 con 0x7f0cb00051d0 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc003bc0 con 0x7f0cb00051d0 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc27fc640 1 -- 172.21.15.28:0/1867428027 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc005020 con 0x7f0cb00051d0 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 msgr2=0x7f0cb000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cb000b9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc001e70 tx=0x7f0cbc01c780 comp rx=0 tx=0).stop 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- 172.21.15.28:0/1867428027 shutdown_connections 2024-09-15T22:56:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 --2- 172.21.15.28:0/1867428027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cb000b9d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- 172.21.15.28:0/1867428027 >> 172.21.15.28:0/1867428027 conn(0x7f0cc4067e00 msgr2=0x7f0cc4068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- 172.21.15.28:0/1867428027 shutdown_connections 2024-09-15T22:56:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- 172.21.15.28:0/1867428027 wait complete. 2024-09-15T22:56:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 Processor -- start 2024-09-15T22:56:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- start start 2024-09-15T22:56:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cc41f7da0 0x7f0cc41f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cc41f3a70 0x7f0cc40c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc40b3760 con 0x7f0cb00051d0 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc40b35e0 con 0x7f0cc41f3a70 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc9746640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc40b38e0 con 0x7f0cc41f7da0 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36074/0 (socket says 172.21.15.28:36074) 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.288+0000 7f0cc2ffd640 1 -- 172.21.15.28:0/3186303694 learned_addr learned my addr 172.21.15.28:0/3186303694 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 -- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cc41f7da0 msgr2=0x7f0cc41f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cc41f7da0 0x7f0cc41f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 -- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cc41f3a70 msgr2=0x7f0cc40c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cc41f3a70 0x7f0cc40c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 -- 172.21.15.28:0/3186303694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4155d90 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc2ffd640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4010900 tx=0x7f0cb4010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400f040 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4004220 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400e9c0 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc4154cf0 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc41552b0 con 0x7f0cb00051d0 2024-09-15T22:56:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc41559d0 con 0x7f0cb00051d0 2024-09-15T22:56:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cb400eb60 con 0x7f0cb00051d0 2024-09-15T22:56:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 0x7f0ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb4085d20 con 0x7f0cb00051d0 2024-09-15T22:56:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbbfff640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 0x7f0ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.292+0000 7f0cbbfff640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 0x7f0ca4069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001210 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.296+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0cb4018030 con 0x7f0cb00051d0 2024-09-15T22:56:51.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.460+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0cc40b9c90 con 0x7f0cb00051d0 2024-09-15T22:56:51.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cbb7fe640 1 -- 172.21.15.28:0/3186303694 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0cb4056850 con 0x7f0cb00051d0 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 msgr2=0x7f0ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 0x7f0ca4069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001210 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 msgr2=0x7f0cc4157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4010900 tx=0x7f0cb4010dc0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 shutdown_connections 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0ca40678c0 0x7f0ca4069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cc41f3a70 0x7f0cc40c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0cc41f7da0 0x7f0cc41f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 --2- 172.21.15.28:0/3186303694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0cb00051d0 0x7f0cc4157200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 >> 172.21.15.28:0/3186303694 conn(0x7f0cc4067e00 msgr2=0x7f0cc40d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:51.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 shutdown_connections 2024-09-15T22:56:51.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.464+0000 7f0cc9746640 1 -- 172.21.15.28:0/3186303694 wait complete. 2024-09-15T22:56:51.486 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:56:51.486 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:56:51.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:56:51.621 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:56:51.621 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:51.622 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:51.628 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:51.628 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:51.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:51.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 Processor -- start 2024-09-15T22:56:51.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 -- start start 2024-09-15T22:56:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b80b5200 0x7fa3b815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3b80cca90 0x7fa3b80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 0x7fa3b80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b80ce3b0 con 0x7fa3b80b5200 2024-09-15T22:56:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b815c5f0 con 0x7fa3b80cca90 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bf4f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b80b2730 con 0x7fa3b80b1dc0 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b80b5200 0x7fa3b815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b80b5200 0x7fa3b815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36088/0 (socket says 172.21.15.28:36088) 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 -- 172.21.15.28:0/373127867 learned_addr learned my addr 172.21.15.28:0/373127867 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bca93640 1 --2- 172.21.15.28:0/373127867 >> v2:172.21.15.131:3300/0 conn(0x7fa3b80cca90 0x7fa3b80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bda95640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 0x7fa3b80b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 -- 172.21.15.28:0/373127867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 msgr2=0x7fa3b80b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 0x7fa3b80b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 -- 172.21.15.28:0/373127867 >> v2:172.21.15.131:3300/0 conn(0x7fa3b80cca90 msgr2=0x7fa3b80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 --2- 172.21.15.28:0/373127867 >> v2:172.21.15.131:3300/0 conn(0x7fa3b80cca90 0x7fa3b80b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bd294640 1 -- 172.21.15.28:0/373127867 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b80b55e0 con 0x7fa3b80b5200 2024-09-15T22:56:51.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.848+0000 7fa3bda95640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 0x7fa3b80b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bd294640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b815c0b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80cf3a0 tx=0x7fa3b401e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2317ec2f62c6f9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3affff640 1 -- 172.21.15.28:0/373127867 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40ab400 con 0x7fa3b80b5200 2024-09-15T22:56:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3affff640 1 -- 172.21.15.28:0/373127867 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b40ab5a0 con 0x7fa3b80b5200 2024-09-15T22:56:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3affff640 1 -- 172.21.15.28:0/373127867 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40ab970 con 0x7fa3b80b5200 2024-09-15T22:56:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/373127867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 msgr2=0x7fa3b815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b815c0b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80cf3a0 tx=0x7fa3b401e680 comp rx=0 tx=0).stop 2024-09-15T22:56:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/373127867 shutdown_connections 2024-09-15T22:56:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80b1dc0 0x7fa3b80b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/373127867 >> v2:172.21.15.131:3300/0 conn(0x7fa3b80cca90 0x7fa3b80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/373127867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b815c0b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/373127867 >> 172.21.15.28:0/373127867 conn(0x7fa3b806bcc0 msgr2=0x7fa3b806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/373127867 shutdown_connections 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.852+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/373127867 wait complete. 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 Processor -- start 2024-09-15T22:56:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- start start 2024-09-15T22:56:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 0x7fa3b8072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 0x7fa3b8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b80b3d60 con 0x7fa3b80b5200 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b80cd8c0 con 0x7fa3b80b1dc0 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b80b3ee0 con 0x7fa3b80cca90 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36096/0 (socket says 172.21.15.28:36096) 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 -- 172.21.15.28:0/781754083 learned_addr learned my addr 172.21.15.28:0/781754083 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bd294640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 0x7fa3b8072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bda95640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 0x7fa3b8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 -- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 msgr2=0x7fa3b8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 0x7fa3b8071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 -- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 msgr2=0x7fa3b8072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 0x7fa3b8072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 -- 172.21.15.28:0/781754083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b80b4910 con 0x7fa3b80b5200 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bd294640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 0x7fa3b8072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bda95640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 0x7fa3b8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bca93640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800d620 tx=0x7fa3a800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800b620 con 0x7fa3b80b5200 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8019070 con 0x7fa3b80b5200 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b8158d30 con 0x7fa3b80b5200 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800b9e0 con 0x7fa3b80b5200 2024-09-15T22:56:51.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b8158fa0 con 0x7fa3b80b5200 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b815c0b0 con 0x7fa3b80b5200 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.856+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3a800bb80 con 0x7fa3b80b5200 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.860+0000 7fa3adffb640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 0x7fa39c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.860+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa3a80860b0 con 0x7fa3b80b5200 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.860+0000 7fa3bd294640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 0x7fa39c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.860+0000 7fa3bd294640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 0x7fa39c069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40b0000 tx=0x7fa3b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:51.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:51.864+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3a8056bd0 con 0x7fa3b80b5200 2024-09-15T22:56:52.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.044+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa3b80b0400 con 0x7fa3b80b5200 2024-09-15T22:56:52.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.044+0000 7fa3adffb640 1 -- 172.21.15.28:0/781754083 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fa3a80564d0 con 0x7fa3b80b5200 2024-09-15T22:56:52.047 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 msgr2=0x7fa39c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 0x7fa39c069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40b0000 tx=0x7fa3b4008040 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 msgr2=0x7fa3b8153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800d620 tx=0x7fa3a800dae0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 shutdown_connections 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3b80cca90 0x7fa3b8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3b80b5200 0x7fa3b8153f10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa39c0678c0 0x7fa39c069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 --2- 172.21.15.28:0/781754083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3b80b1dc0 0x7fa3b8072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 >> 172.21.15.28:0/781754083 conn(0x7fa3b806bcc0 msgr2=0x7fa3b80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 shutdown_connections 2024-09-15T22:56:52.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.048+0000 7fa3bf4f8640 1 -- 172.21.15.28:0/781754083 wait complete. 2024-09-15T22:56:52.067 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:52.067 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:52.073 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:52.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 Processor -- start 2024-09-15T22:56:52.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 -- start start 2024-09-15T22:56:52.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 0x7f21c806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f21c815e820 0x7f21c80cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c806e190 con 0x7f21c80b3610 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f21c80d2ba0 con 0x7f21c815e820 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cf13b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f21c80d2e80 con 0x7f21c806d870 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21c7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f21c815e820 0x7f21c80cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cd6d8640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f21c80b3610 0x7f21c80d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38532/0 (socket says 172.21.15.28:38532) 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cd6d8640 1 -- 172.21.15.28:0/1142888449 learned_addr learned my addr 172.21.15.28:0/1142888449 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21cced7640 1 --2- 172.21.15.28:0/1142888449 >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 0x7f21c806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.244+0000 7f21c77fe640 1 -- 172.21.15.28:0/1142888449 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924938622 0 0) 0x7f21c806e190 con 0x7f21c80b3610 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c77fe640 1 -- 172.21.15.28:0/1142888449 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21b4003530 con 0x7f21c80b3610 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c7fff640 1 -- 172.21.15.28:0/1142888449 >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 msgr2=0x7f21c806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c7fff640 1 --2- 172.21.15.28:0/1142888449 >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 0x7f21c806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c7fff640 1 -- 172.21.15.28:0/1142888449 >> v1:172.21.15.28:6789/0 conn(0x7f21c80b3610 legacy=0x7f21c80d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c7fff640 1 -- 172.21.15.28:0/1142888449 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c80d3160 con 0x7f21c815e820 2024-09-15T22:56:52.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cced7640 1 --2- 172.21.15.28:0/1142888449 >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 0x7f21c806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:52.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c7fff640 1 --2- 172.21.15.28:0/1142888449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c80cf750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21c80505a0 tx=0x7f21b001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883247f4995d416c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c77fe640 1 -- 172.21.15.28:0/1142888449 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00b2070 con 0x7f21c815e820 2024-09-15T22:56:52.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c77fe640 1 -- 172.21.15.28:0/1142888449 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b00a59f0 con 0x7f21c815e820 2024-09-15T22:56:52.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21c77fe640 1 -- 172.21.15.28:0/1142888449 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00a5da0 con 0x7f21c815e820 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 -- 172.21.15.28:0/1142888449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 msgr2=0x7f21c80cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 --2- 172.21.15.28:0/1142888449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c80cf750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21c80505a0 tx=0x7f21b001c930 comp rx=0 tx=0).stop 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 -- 172.21.15.28:0/1142888449 shutdown_connections 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 --2- 172.21.15.28:0/1142888449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c80cf750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 --2- 172.21.15.28:0/1142888449 >> v2:172.21.15.131:3300/0 conn(0x7f21c806d870 0x7f21c806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 -- 172.21.15.28:0/1142888449 >> 172.21.15.28:0/1142888449 conn(0x7f21c80d4910 msgr2=0x7f21c80d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 -- 172.21.15.28:0/1142888449 shutdown_connections 2024-09-15T22:56:52.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.248+0000 7f21cf13b640 1 -- 172.21.15.28:0/1142888449 wait complete. 2024-09-15T22:56:52.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 Processor -- start 2024-09-15T22:56:52.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- start start 2024-09-15T22:56:52.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c806d870 0x7f21c8160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c80b3610 0x7f21c80cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f21c816b1a0 con 0x7f21c815e820 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f21c80d4350 con 0x7f21c806d870 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f21c816b320 con 0x7f21c80b3610 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36120/0 (socket says 172.21.15.28:36120) 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 -- 172.21.15.28:0/346071917 learned_addr learned my addr 172.21.15.28:0/346071917 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21c7fff640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c80b3610 0x7f21c80cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cced7640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c806d870 0x7f21c8160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 -- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c80b3610 msgr2=0x7f21c80cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c80b3610 0x7f21c80cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 -- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c806d870 msgr2=0x7f21c8160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c806d870 0x7f21c8160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 -- 172.21.15.28:0/346071917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c80b3c30 con 0x7f21c815e820 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cd6d8640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c450 tx=0x7f21c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0017070 con 0x7f21c815e820 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0005cf0 con 0x7f21c815e820 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c80c8110 con 0x7f21c815e820 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00072b0 con 0x7f21c815e820 2024-09-15T22:56:52.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c80c86d0 con 0x7f21c815e820 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.252+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c80cf750 con 0x7f21c815e820 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.256+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21c001a070 con 0x7f21c815e820 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.256+0000 7f21c57fa640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 0x7f21a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.256+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f21c0085290 con 0x7f21c815e820 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.256+0000 7f21cced7640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 0x7f21a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.256+0000 7f21cced7640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 0x7f21a8069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21c8168820 tx=0x7f21b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.260+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21c0055db0 con 0x7f21c815e820 2024-09-15T22:56:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21c8069450 con 0x7f21c815e820 2024-09-15T22:56:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21c57fa640 1 -- 172.21.15.28:0/346071917 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f21c00556b0 con 0x7f21c815e820 2024-09-15T22:56:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 msgr2=0x7f21a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 0x7f21a8069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21c8168820 tx=0x7f21b8008040 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 msgr2=0x7f21c815fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c450 tx=0x7f21c000c910 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 shutdown_connections 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21c815e820 0x7f21c815fca0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21c80b3610 0x7f21c80cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21a80678c0 0x7f21a8069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 --2- 172.21.15.28:0/346071917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21c806d870 0x7f21c8160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 >> 172.21.15.28:0/346071917 conn(0x7f21c80d4910 msgr2=0x7f21c80b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 shutdown_connections 2024-09-15T22:56:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.444+0000 7f21cf13b640 1 -- 172.21.15.28:0/346071917 wait complete. 2024-09-15T22:56:52.465 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:56:52.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:52.466 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:56:52.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:56:52.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:56:52.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:52.483 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:56:52.539 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:52.539 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:52.546 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:52.546 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:52.593 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 Processor -- start 2024-09-15T22:56:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 -- start start 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1c40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1c40b2300 0x7fd1c40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c40d0960 con 0x7fd1c40d0190 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c40d0f20 con 0x7fd1c40b2300 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1cb002640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c40cd620 con 0x7fd1c4145970 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c959f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd1c40d0190 0x7fd1c4072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38538/0 (socket says 172.21.15.28:38538) 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c959f640 1 -- 172.21.15.28:0/387523464 learned_addr learned my addr 172.21.15.28:0/387523464 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/387523464 >> v2:172.21.15.131:3300/0 conn(0x7fd1c40b2300 0x7fd1c40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1c40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233688437 0 0) 0x7fd1c40d0960 con 0x7fd1c40d0190 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1ac003530 con 0x7fd1c40d0190 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1886551633 0 0) 0x7fd1ac003530 con 0x7fd1c40d0190 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 msgr2=0x7fd1c40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1c40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 >> v2:172.21.15.131:3300/0 conn(0x7fd1c40b2300 msgr2=0x7fd1c40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 --2- 172.21.15.28:0/387523464 >> v2:172.21.15.131:3300/0 conn(0x7fd1c40b2300 0x7fd1c40cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40d0c40 con 0x7fd1c40d0190 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd1bc001a00 con 0x7fd1c40d0190 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 >> v1:172.21.15.28:6789/0 conn(0x7fd1c40d0190 legacy=0x7fd1c4072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1ac003f40 0x7fd1ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40d0f20 con 0x7fd1ac004d50 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40cd620 con 0x7fd1ac003f40 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac00ba20 con 0x7fd1c4145970 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.716+0000 7fd1c959f640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1ac003f40 0x7fd1ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 -- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 msgr2=0x7fd1ac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1ac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 -- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1ac003f40 msgr2=0x7fd1ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1ac003f40 0x7fd1ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 -- 172.21.15.28:0/387523464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac003530 con 0x7fd1ac004d50 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1ac003f40 0x7fd1ac004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c4145970 0x7fd1ac0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a8b0 tx=0x7fd1bc01fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2be4dde0cdee74d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00a4a0 con 0x7fd1ac004d50 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0ad020 con 0x7fd1ac004d50 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c37fe640 1 -- 172.21.15.28:0/387523464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0a9720 con 0x7fd1ac004d50 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 -- 172.21.15.28:0/387523464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1ac004d50 msgr2=0x7fd1ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 --2- 172.21.15.28:0/387523464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a8b0 tx=0x7fd1bc01fb00 comp rx=0 tx=0).stop 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1c959f640 1 -- 172.21.15.28:0/387523464 reap_dead start 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 -- 172.21.15.28:0/387523464 shutdown_connections 2024-09-15T22:56:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 -- 172.21.15.28:0/387523464 >> 172.21.15.28:0/387523464 conn(0x7fd1c406bcc0 msgr2=0x7fd1c406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 -- 172.21.15.28:0/387523464 shutdown_connections 2024-09-15T22:56:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.720+0000 7fd1cb002640 1 -- 172.21.15.28:0/387523464 wait complete. 2024-09-15T22:56:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 Processor -- start 2024-09-15T22:56:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- start start 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 0x7fd1c40ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c40ae190 0x7fd1c40ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40d0620 con 0x7fd1c40aeb50 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c40b2740 con 0x7fd1c415bcf0 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c4145d50 con 0x7fd1c40ae190 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36136/0 (socket says 172.21.15.28:36136) 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 -- 172.21.15.28:0/2878107906 learned_addr learned my addr 172.21.15.28:0/2878107906 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 0x7fd1c40ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c40ae190 0x7fd1c40ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 -- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c40ae190 msgr2=0x7fd1c40ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c40ae190 0x7fd1c40ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 -- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 msgr2=0x7fd1c40ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 0x7fd1c40ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 -- 172.21.15.28:0/2878107906 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40cc280 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 0x7fd1c40ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c959f640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a8b0 tx=0x7fd1ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00a4a0 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0b6070 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c40af1a0 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc002000 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c40af760 con 0x7fd1c40aeb50 2024-09-15T22:56:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c40d07a0 con 0x7fd1c40aeb50 2024-09-15T22:56:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1bc0a9920 con 0x7fd1c40aeb50 2024-09-15T22:56:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.724+0000 7fd1c17fa640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 0x7fd1b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.728+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1bc122c00 con 0x7fd1c40aeb50 2024-09-15T22:56:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.728+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 0x7fd1b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.728+0000 7fd1c8d9e640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 0x7fd1b0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40b15a0 tx=0x7fd1b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.732+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1bc129080 con 0x7fd1c40aeb50 2024-09-15T22:56:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.904+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1c4073ee0 con 0x7fd1c40aeb50 2024-09-15T22:56:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.904+0000 7fd1c17fa640 1 -- 172.21.15.28:0/2878107906 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fd1bc019810 con 0x7fd1c40aeb50 2024-09-15T22:56:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 msgr2=0x7fd1b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 0x7fd1b0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40b15a0 tx=0x7fd1b4008040 comp rx=0 tx=0).stop 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 msgr2=0x7fd1c40b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a8b0 tx=0x7fd1ac005840 comp rx=0 tx=0).stop 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 shutdown_connections 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1c40aeb50 0x7fd1c40b3230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1c40ae190 0x7fd1c40ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1b00678f0 0x7fd1b0069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 --2- 172.21.15.28:0/2878107906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1c415bcf0 0x7fd1c40ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:52.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 >> 172.21.15.28:0/2878107906 conn(0x7fd1c406bcc0 msgr2=0x7fd1c415e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:52.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 shutdown_connections 2024-09-15T22:56:52.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:52.908+0000 7fd1cb002640 1 -- 172.21.15.28:0/2878107906 wait complete. 2024-09-15T22:56:52.926 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:52.926 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:52.933 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 Processor -- start 2024-09-15T22:56:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 -- start start 2024-09-15T22:56:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53d40d0140 0x7f53d4166f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d406ccd0 con 0x7f53d415f800 2024-09-15T22:56:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d4071680 con 0x7f53d406fe80 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d9025640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f53d4073330 con 0x7f53d40d0140 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d2d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f53d415f800 0x7f53d4072c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56404/0 (socket says 172.21.15.28:56404) 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d2d9d640 1 -- 172.21.15.28:0/1762294240 learned_addr learned my addr 172.21.15.28:0/1762294240 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619006479 0 0) 0x7f53d406ccd0 con 0x7f53d415f800 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d359e640 1 --2- 172.21.15.28:0/1762294240 >> v2:172.21.15.131:3300/0 conn(0x7f53d40d0140 0x7f53d4166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003530 con 0x7f53d415f800 2024-09-15T22:56:53.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2332378976 0 0) 0x7f53bc003530 con 0x7f53d415f800 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 >> v2:172.21.15.131:3300/0 conn(0x7f53d40d0140 msgr2=0x7f53d4166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 --2- 172.21.15.28:0/1762294240 >> v2:172.21.15.131:3300/0 conn(0x7f53d40d0140 0x7f53d4166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 >> v1:172.21.15.131:6789/0 conn(0x7f53d406fe80 legacy=0x7f53d40cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d4071960 con 0x7f53d415f800 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f53c4001680 con 0x7f53d415f800 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 >> v1:172.21.15.28:6789/0 conn(0x7f53d415f800 legacy=0x7f53d4072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53bc0039c0 0x7f53bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 0x7f53bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc0051d0 0x7f53bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4073330 con 0x7f53bc004810 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc00c070 con 0x7f53bc0039c0 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc00c270 con 0x7f53bc0051d0 2024-09-15T22:56:53.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 0x7f53bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 -- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc0051d0 msgr2=0x7f53bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc0051d0 0x7f53bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 -- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53bc0039c0 msgr2=0x7f53bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53bc0039c0 0x7f53bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d259c640 1 -- 172.21.15.28:0/1762294240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc003530 con 0x7f53bc004810 2024-09-15T22:56:53.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.048+0000 7f53d359e640 1 -- 172.21.15.28:0/1762294240 reap_dead start 2024-09-15T22:56:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d259c640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 0x7f53bc004c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001780 tx=0x7f53c801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4144b87d087e7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c80013a0 con 0x7f53bc004810 2024-09-15T22:56:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c80052f0 con 0x7f53bc004810 2024-09-15T22:56:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d1d9b640 1 -- 172.21.15.28:0/1762294240 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8003840 con 0x7f53bc004810 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 msgr2=0x7f53bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 0x7f53bc004c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001780 tx=0x7f53c801c400 comp rx=0 tx=0).stop 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- 172.21.15.28:0/1762294240 shutdown_connections 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 --2- 172.21.15.28:0/1762294240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53bc004810 0x7f53bc004c90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- 172.21.15.28:0/1762294240 >> 172.21.15.28:0/1762294240 conn(0x7f53d40cd7f0 msgr2=0x7f53d40cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- 172.21.15.28:0/1762294240 shutdown_connections 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- 172.21.15.28:0/1762294240 wait complete. 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 Processor -- start 2024-09-15T22:56:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- start start 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc004810 0x7f53d414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 0x7f53d40aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4071f20 con 0x7f53d40b4910 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53d415fbe0 con 0x7f53d40ae8b0 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d9025640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53d4072200 con 0x7f53bc004810 2024-09-15T22:56:53.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50218/0 (socket says 172.21.15.28:50218) 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d359e640 1 -- 172.21.15.28:0/1516107713 learned_addr learned my addr 172.21.15.28:0/1516107713 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.052+0000 7f53d2d9d640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc004810 0x7f53d414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d259c640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 0x7f53d40aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 -- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc004810 msgr2=0x7f53d414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc004810 0x7f53d414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 -- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 msgr2=0x7f53d40aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 0x7f53d40aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 -- 172.21.15.28:0/1516107713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41e5d30 con 0x7f53d40b4910 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d259c640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 0x7f53d40aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d359e640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b5f50 tx=0x7f53cc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00bab0 con 0x7f53d40b4910 2024-09-15T22:56:53.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc01a070 con 0x7f53d40b4910 2024-09-15T22:56:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41e6010 con 0x7f53d40b4910 2024-09-15T22:56:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc014400 con 0x7f53d40b4910 2024-09-15T22:56:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d40b52d0 con 0x7f53d40b4910 2024-09-15T22:56:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d4072720 con 0x7f53d40b4910 2024-09-15T22:56:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53cc013070 con 0x7f53d40b4910 2024-09-15T22:56:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 0x7f53c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f53cc085d70 con 0x7f53d40b4910 2024-09-15T22:56:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d2d9d640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 0x7f53c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.056+0000 7f53d2d9d640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 0x7f53c0069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004880 tx=0x7f53d4071850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.060+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53cc024020 con 0x7f53d40b4910 2024-09-15T22:56:53.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.232+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53d415efc0 con 0x7f53d40b4910 2024-09-15T22:56:53.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.232+0000 7f53bb7fe640 1 -- 172.21.15.28:0/1516107713 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f53cc056940 con 0x7f53d40b4910 2024-09-15T22:56:53.235 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:53.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 msgr2=0x7f53c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 0x7f53c0069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004880 tx=0x7f53d4071850 comp rx=0 tx=0).stop 2024-09-15T22:56:53.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 msgr2=0x7f53d40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b5f50 tx=0x7f53cc00eec0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 shutdown_connections 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53d40b4910 0x7f53d40b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53c00678f0 0x7f53c0069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53d40ae8b0 0x7f53d40aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 --2- 172.21.15.28:0/1516107713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53bc004810 0x7f53d414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 >> 172.21.15.28:0/1516107713 conn(0x7f53d40cd7f0 msgr2=0x7f53d40ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 shutdown_connections 2024-09-15T22:56:53.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.236+0000 7f53d9025640 1 -- 172.21.15.28:0/1516107713 wait complete. 2024-09-15T22:56:53.252 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-09-15T22:56:53.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:53.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T22:56:53.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:56:53.279 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:56:53.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:53.279 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:56:53.332 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:53.332 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:53.338 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:53.338 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:53.385 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:53.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 Processor -- start 2024-09-15T22:56:53.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 -- start start 2024-09-15T22:56:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe44c158e00 0x7fe44c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c15c500 con 0x7fe44c0b5cf0 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c0cf900 con 0x7fe44c15ec60 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe451923640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe44c06f2a0 con 0x7fe44c158e00 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe44c158e00 0x7fe44c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe44c0b5cf0 0x7fe44c15bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56408/0 (socket says 172.21.15.28:56408) 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44b7fe640 1 -- 172.21.15.28:0/1151439186 learned_addr learned my addr 172.21.15.28:0/1151439186 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44affd640 1 -- 172.21.15.28:0/1151439186 >> v1:172.21.15.131:6789/0 conn(0x7fe44c15ec60 legacy=0x7fe44c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44affd640 1 -- 172.21.15.28:0/1151439186 >> v1:172.21.15.28:6789/0 conn(0x7fe44c0b5cf0 legacy=0x7fe44c15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe44affd640 1 -- 172.21.15.28:0/1151439186 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c0cfbe0 con 0x7fe44c158e00 2024-09-15T22:56:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.540+0000 7fe449ffb640 1 -- 172.21.15.28:0/1151439186 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177035722 0 0) 0x7fe44c15c500 con 0x7fe44c0b5cf0 2024-09-15T22:56:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe44affd640 1 --2- 172.21.15.28:0/1151439186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c158e00 0x7fe44c0ce820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0097c0 tx=0x7fe43c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58535aec2fa0af10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe449ffb640 1 -- 172.21.15.28:0/1151439186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0b0070 con 0x7fe44c158e00 2024-09-15T22:56:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe449ffb640 1 -- 172.21.15.28:0/1151439186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c0ab600 con 0x7fe44c158e00 2024-09-15T22:56:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe449ffb640 1 -- 172.21.15.28:0/1151439186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0ab9d0 con 0x7fe44c158e00 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- 172.21.15.28:0/1151439186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c158e00 msgr2=0x7fe44c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 --2- 172.21.15.28:0/1151439186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c158e00 0x7fe44c0ce820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0097c0 tx=0x7fe43c01c460 comp rx=0 tx=0).stop 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- 172.21.15.28:0/1151439186 shutdown_connections 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 --2- 172.21.15.28:0/1151439186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c158e00 0x7fe44c0ce820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- 172.21.15.28:0/1151439186 >> 172.21.15.28:0/1151439186 conn(0x7fe44c0b0740 msgr2=0x7fe44c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- 172.21.15.28:0/1151439186 shutdown_connections 2024-09-15T22:56:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- 172.21.15.28:0/1151439186 wait complete. 2024-09-15T22:56:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 Processor -- start 2024-09-15T22:56:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.544+0000 7fe451923640 1 -- start start 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0b5cf0 0x7fe44c135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe44c158e00 0x7fe44c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c15f8e0 con 0x7fe44c15ec60 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c0ced60 con 0x7fe44c0b5cf0 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c15fa60 con 0x7fe44c158e00 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50228/0 (socket says 172.21.15.28:50228) 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 -- 172.21.15.28:0/3847081589 learned_addr learned my addr 172.21.15.28:0/3847081589 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44affd640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0b5cf0 0x7fe44c135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44a7fc640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe44c158e00 0x7fe44c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 -- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe44c158e00 msgr2=0x7fe44c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe44c158e00 0x7fe44c15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 -- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0b5cf0 msgr2=0x7fe44c135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0b5cf0 0x7fe44c135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 -- 172.21.15.28:0/3847081589 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c1392b0 con 0x7fe44c15ec60 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44b7fe640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe444001570 tx=0x7fe44400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444018070 con 0x7fe44c15ec60 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44400a640 con 0x7fe44c15ec60 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44400aa30 con 0x7fe44c15ec60 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c1363b0 con 0x7fe44c15ec60 2024-09-15T22:56:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c136970 con 0x7fe44c15ec60 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44c0ce820 con 0x7fe44c15ec60 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe44401b070 con 0x7fe44c15ec60 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 0x7fe438069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44affd640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 0x7fe438069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe444085250 con 0x7fe44c15ec60 2024-09-15T22:56:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.548+0000 7fe44affd640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 0x7fe438069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0ad000 tx=0x7fe43c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.552+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe444055740 con 0x7fe44c15ec60 2024-09-15T22:56:53.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.724+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe44c06d490 con 0x7fe44c15ec60 2024-09-15T22:56:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe433fff640 1 -- 172.21.15.28:0/3847081589 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe444059a40 con 0x7fe44c15ec60 2024-09-15T22:56:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 msgr2=0x7fe438069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 0x7fe438069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0ad000 tx=0x7fe43c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 msgr2=0x7fe44c15de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe444001570 tx=0x7fe44400cca0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 shutdown_connections 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe44c15ec60 0x7fe44c15de10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe44c158e00 0x7fe44c15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4380678c0 0x7fe438069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 --2- 172.21.15.28:0/3847081589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0b5cf0 0x7fe44c135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 >> 172.21.15.28:0/3847081589 conn(0x7fe44c0b0740 msgr2=0x7fe44c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 shutdown_connections 2024-09-15T22:56:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.728+0000 7fe451923640 1 -- 172.21.15.28:0/3847081589 wait complete. 2024-09-15T22:56:53.748 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:56:53.748 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:53.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.908+0000 7f082b4f8640 1 Processor -- start 2024-09-15T22:56:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.908+0000 7f082b4f8640 1 -- start start 2024-09-15T22:56:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08240cca90 0x7f082415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 0x7f08240b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08240b55e0 con 0x7f08240b5200 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f08240ce3b0 con 0x7f08240cca90 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f082415c5f0 con 0x7f08240b1dc0 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08240cca90 0x7f082415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08240cca90 0x7f082415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50234/0 (socket says 172.21.15.28:50234) 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 -- 172.21.15.28:0/974863775 learned_addr learned my addr 172.21.15.28:0/974863775 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0829a95640 1 --2- 172.21.15.28:0/974863775 >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 0x7f08240b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 -- 172.21.15.28:0/974863775 >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 msgr2=0x7f08240b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 --2- 172.21.15.28:0/974863775 >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 0x7f08240b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 -- 172.21.15.28:0/974863775 >> v1:172.21.15.131:6789/0 conn(0x7f08240b5200 legacy=0x7f08240b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 -- 172.21.15.28:0/974863775 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08240b2710 con 0x7f08240cca90 2024-09-15T22:56:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0829a95640 1 --2- 172.21.15.28:0/974863775 >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 0x7f08240b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f0828a93640 1 --2- 172.21.15.28:0/974863775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240cca90 0x7f082415c0b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f082406cc00 tx=0x7f081401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc6977e5af14c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f081bfff640 1 -- 172.21.15.28:0/974863775 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140b0070 con 0x7f08240cca90 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f081bfff640 1 -- 172.21.15.28:0/974863775 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08140ab600 con 0x7f08240cca90 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f081bfff640 1 -- 172.21.15.28:0/974863775 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08140ab9d0 con 0x7f08240cca90 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- 172.21.15.28:0/974863775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240cca90 msgr2=0x7f082415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 --2- 172.21.15.28:0/974863775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240cca90 0x7f082415c0b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f082406cc00 tx=0x7f081401c450 comp rx=0 tx=0).stop 2024-09-15T22:56:53.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- 172.21.15.28:0/974863775 shutdown_connections 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 --2- 172.21.15.28:0/974863775 >> v2:172.21.15.131:3300/0 conn(0x7f08240b1dc0 0x7f08240b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 --2- 172.21.15.28:0/974863775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240cca90 0x7f082415c0b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- 172.21.15.28:0/974863775 >> 172.21.15.28:0/974863775 conn(0x7f082406bcc0 msgr2=0x7f082406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- 172.21.15.28:0/974863775 shutdown_connections 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.912+0000 7f082b4f8640 1 -- 172.21.15.28:0/974863775 wait complete. 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 Processor -- start 2024-09-15T22:56:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- start start 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08240b5200 0x7f0824071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08240cca90 0x7f082415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f08240b3d60 con 0x7f08240b1dc0 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f08240cd8c0 con 0x7f08240cca90 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f08240b3ee0 con 0x7f08240b5200 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50240/0 (socket says 172.21.15.28:50240) 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 -- 172.21.15.28:0/1420875707 learned_addr learned my addr 172.21.15.28:0/1420875707 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 -- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08240b5200 msgr2=0x7f0824071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08240b5200 0x7f0824071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 -- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08240cca90 msgr2=0x7f082415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829a95640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08240cca90 0x7f082415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08240cca90 0x7f082415a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 -- 172.21.15.28:0/1420875707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08240723a0 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0829294640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f082000c450 tx=0x7f082000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820012830 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820017070 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0824155d40 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820012c10 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0824156300 con 0x7f08240b1dc0 2024-09-15T22:56:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08240b21d0 con 0x7f08240b1dc0 2024-09-15T22:56:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.916+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f082001c460 con 0x7f08240b1dc0 2024-09-15T22:56:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.920+0000 7f0819ffb640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 0x7f0808069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.920+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0820085a00 con 0x7f08240b1dc0 2024-09-15T22:56:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.920+0000 7f0828a93640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 0x7f0808069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.920+0000 7f0828a93640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 0x7f0808069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f082406f1a0 tx=0x7f0814004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:53.924+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f08200565d0 con 0x7f08240b1dc0 2024-09-15T22:56:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0824157570 con 0x7f08240b1dc0 2024-09-15T22:56:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f0819ffb640 1 -- 172.21.15.28:0/1420875707 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0820055ed0 con 0x7f08240b1dc0 2024-09-15T22:56:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:54.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 msgr2=0x7f0808069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 0x7f0808069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f082406f1a0 tx=0x7f0814004740 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 msgr2=0x7f0824155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f082000c450 tx=0x7f082000c910 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 shutdown_connections 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.092+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f08080678f0 0x7f0808069db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08240cca90 0x7f082415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08240b5200 0x7f0824071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 --2- 172.21.15.28:0/1420875707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08240b1dc0 0x7f0824155640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 >> 172.21.15.28:0/1420875707 conn(0x7f082406bcc0 msgr2=0x7f082406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 shutdown_connections 2024-09-15T22:56:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.096+0000 7f082b4f8640 1 -- 172.21.15.28:0/1420875707 wait complete. 2024-09-15T22:56:54.112 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:56:54.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:54.112 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-15T22:56:54.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:56:54.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:56:54.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:54.124 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T22:56:54.173 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:54.173 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:54.179 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:54.180 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:54.236 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 Processor -- start 2024-09-15T22:56:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 -- start start 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1280b24d0 0x7fe1280cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1280d0960 con 0x7fe128145970 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe1280d0f20 con 0x7fe1280b24d0 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12fec0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1280cd620 con 0x7fe1280d0190 2024-09-15T22:56:54.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1280b24d0 0x7fe1280cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1280b24d0 0x7fe1280cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50254/0 (socket says 172.21.15.28:50254) 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 -- 172.21.15.28:0/2452998293 learned_addr learned my addr 172.21.15.28:0/2452998293 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12e45d640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 -- 172.21.15.28:0/2452998293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 msgr2=0x7fe1280cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 -- 172.21.15.28:0/2452998293 >> v1:172.21.15.131:6789/0 conn(0x7fe128145970 legacy=0x7fe1280b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:54.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.364+0000 7fe12d45b640 1 -- 172.21.15.28:0/2452998293 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280d0c40 con 0x7fe1280b24d0 2024-09-15T22:56:54.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12d45b640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe1280cfc50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe1280afd50 tx=0x7fe11801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba38ee2af657a5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12cc5a640 1 -- 172.21.15.28:0/2452998293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1180b0070 con 0x7fe1280b24d0 2024-09-15T22:56:54.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12cc5a640 1 -- 172.21.15.28:0/2452998293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1180ab600 con 0x7fe1280b24d0 2024-09-15T22:56:54.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12cc5a640 1 -- 172.21.15.28:0/2452998293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1180ab9d0 con 0x7fe1280b24d0 2024-09-15T22:56:54.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- 172.21.15.28:0/2452998293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 msgr2=0x7fe1280cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe1280cfc50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe1280afd50 tx=0x7fe11801c420 comp rx=0 tx=0).stop 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- 172.21.15.28:0/2452998293 shutdown_connections 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- 172.21.15.28:0/2452998293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe1280cfc50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- 172.21.15.28:0/2452998293 >> 172.21.15.28:0/2452998293 conn(0x7fe12806bcc0 msgr2=0x7fe12806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- 172.21.15.28:0/2452998293 shutdown_connections 2024-09-15T22:56:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- 172.21.15.28:0/2452998293 wait complete. 2024-09-15T22:56:54.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 Processor -- start 2024-09-15T22:56:54.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- start start 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe128145970 0x7fe12815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280ce980 con 0x7fe1280b24d0 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280ce800 con 0x7fe128145970 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12fec0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1280ceb00 con 0x7fe1280d0190 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50270/0 (socket says 172.21.15.28:50270) 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 -- 172.21.15.28:0/4021898358 learned_addr learned my addr 172.21.15.28:0/4021898358 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12e45d640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe128145970 0x7fe12815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12d45b640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 -- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 msgr2=0x7fe1280b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 -- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe128145970 msgr2=0x7fe12815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe128145970 0x7fe12815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 -- 172.21.15.28:0/4021898358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1281f76b0 con 0x7fe1280b24d0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe12dc5c640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe12400c450 tx=0x7fe12400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124012830 con 0x7fe1280b24d0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.368+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe124017070 con 0x7fe1280b24d0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124012c30 con 0x7fe1280b24d0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1281f7950 con 0x7fe1280b24d0 2024-09-15T22:56:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1281f7f10 con 0x7fe1280b24d0 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1280cfc50 con 0x7fe1280b24d0 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe12401c460 con 0x7fe1280b24d0 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe11e7fc640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 0x7fe10c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe124085ae0 con 0x7fe1280b24d0 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe12d45b640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 0x7fe10c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.372+0000 7fe12d45b640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 0x7fe10c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe1180ad000 tx=0x7fe118008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.376+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe124056580 con 0x7fe1280b24d0 2024-09-15T22:56:54.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe12815d580 con 0x7fe1280b24d0 2024-09-15T22:56:54.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe11e7fc640 1 -- 172.21.15.28:0/4021898358 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe124055e80 con 0x7fe1280b24d0 2024-09-15T22:56:54.546 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:54.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 msgr2=0x7fe10c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 0x7fe10c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe1180ad000 tx=0x7fe118008040 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 msgr2=0x7fe12815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe12400c450 tx=0x7fe12400c910 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.544+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 shutdown_connections 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe10c0678c0 0x7fe10c069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe128145970 0x7fe12815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1280d0190 0x7fe1280b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 --2- 172.21.15.28:0/4021898358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1280b24d0 0x7fe12815bef0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 >> 172.21.15.28:0/4021898358 conn(0x7fe12806bcc0 msgr2=0x7fe12813eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 shutdown_connections 2024-09-15T22:56:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.548+0000 7fe12fec0640 1 -- 172.21.15.28:0/4021898358 wait complete. 2024-09-15T22:56:54.564 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:56:54.564 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:56:54.571 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:56:54.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 Processor -- start 2024-09-15T22:56:54.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 -- start start 2024-09-15T22:56:54.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5460145970 0x7f54600b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600d0360 0x7f54600cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54600d0960 con 0x7f54600b2300 2024-09-15T22:56:54.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f54600b2770 con 0x7f5460145970 2024-09-15T22:56:54.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f54673e3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f54600d0f20 con 0x7f54600d0360 2024-09-15T22:56:54.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f546517f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5460145970 0x7f54600b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f546517f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5460145970 0x7f54600b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:52474/0 (socket says 172.21.15.28:52474) 2024-09-15T22:56:54.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f5465980640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600d0360 0x7f54600cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f546497e640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f54600b2300 0x7f54600cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:51836/0 (socket says 172.21.15.28:51836) 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.680+0000 7f546517f640 1 -- 172.21.15.28:0/3251641548 learned_addr learned my addr 172.21.15.28:0/3251641548 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f546517f640 1 -- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600d0360 msgr2=0x7f54600cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f546517f640 1 --2- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600d0360 0x7f54600cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f546517f640 1 -- 172.21.15.28:0/3251641548 >> v1:172.21.15.131:6789/0 conn(0x7f54600b2300 legacy=0x7f54600cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f546517f640 1 -- 172.21.15.28:0/3251641548 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54600d0c40 con 0x7f5460145970 2024-09-15T22:56:54.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f546517f640 1 --2- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f54600b1dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f545c0098a0 tx=0x7f545c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f975e0eb6e2f5898 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f5457fff640 1 -- 172.21.15.28:0/3251641548 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c0b0070 con 0x7f5460145970 2024-09-15T22:56:54.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f5457fff640 1 -- 172.21.15.28:0/3251641548 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c0ab600 con 0x7f5460145970 2024-09-15T22:56:54.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f5457fff640 1 -- 172.21.15.28:0/3251641548 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c0ab9d0 con 0x7f5460145970 2024-09-15T22:56:54.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 -- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 msgr2=0x7f54600b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 --2- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f54600b1dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f545c0098a0 tx=0x7f545c01c4b0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 -- 172.21.15.28:0/3251641548 shutdown_connections 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 --2- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600d0360 0x7f54600cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 --2- 172.21.15.28:0/3251641548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f54600b1dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 -- 172.21.15.28:0/3251641548 >> 172.21.15.28:0/3251641548 conn(0x7f546006bcc0 msgr2=0x7f546006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 -- 172.21.15.28:0/3251641548 shutdown_connections 2024-09-15T22:56:54.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.684+0000 7f54673e3640 1 -- 172.21.15.28:0/3251641548 wait complete. 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 Processor -- start 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- start start 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600b2300 0x7f54601406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f546013b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f54600ceb90 con 0x7f54600d0360 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f54600cea10 con 0x7f5460145970 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f54600ced10 con 0x7f54600b2300 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50272/0 (socket says 172.21.15.28:50272) 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 -- 172.21.15.28:0/536998369 learned_addr learned my addr 172.21.15.28:0/536998369 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f5465980640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f546013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546517f640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600b2300 0x7f54601406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 -- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600b2300 msgr2=0x7f54601406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600b2300 0x7f54601406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 -- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 msgr2=0x7f546013b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f546013b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 -- 172.21.15.28:0/536998369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460140cd0 con 0x7f54600d0360 2024-09-15T22:56:54.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f546497e640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f545000c400 tx=0x7f545000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54500074e0 con 0x7f54600d0360 2024-09-15T22:56:54.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54500047f0 con 0x7f54600d0360 2024-09-15T22:56:54.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5460140fb0 con 0x7f54600d0360 2024-09-15T22:56:54.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54500076a0 con 0x7f54600d0360 2024-09-15T22:56:54.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5460141570 con 0x7f54600d0360 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.688+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54600cda90 con 0x7f54600d0360 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.692+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f545001a020 con 0x7f54600d0360 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.692+0000 7f5455ffb640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 0x7f5444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.692+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5450085480 con 0x7f54600d0360 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.692+0000 7f546517f640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 0x7f5444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:54.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.692+0000 7f546517f640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 0x7f5444069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f545c0ad000 tx=0x7f545c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:54.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.696+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5450055f20 con 0x7f54600d0360 2024-09-15T22:56:54.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.868+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54600cfc30 con 0x7f54600d0360 2024-09-15T22:56:54.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.868+0000 7f5455ffb640 1 -- 172.21.15.28:0/536998369 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f5450055820 con 0x7f54600d0360 2024-09-15T22:56:54.872 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:56:54.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 msgr2=0x7f5444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 0x7f5444069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f545c0ad000 tx=0x7f545c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 msgr2=0x7f5460141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f545000c400 tx=0x7f545000c8c0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 shutdown_connections 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f54440678c0 0x7f5444069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5460145970 0x7f546013b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54600d0360 0x7f5460141d70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 --2- 172.21.15.28:0/536998369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54600b2300 0x7f54601406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 >> 172.21.15.28:0/536998369 conn(0x7f546006bcc0 msgr2=0x7f546015ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 shutdown_connections 2024-09-15T22:56:54.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:54.872+0000 7f54673e3640 1 -- 172.21.15.28:0/536998369 wait complete. 2024-09-15T22:56:54.892 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-09-15T22:56:54.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:54.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-15T22:56:54.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:56:54.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:56:54.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:56:54.906 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T22:56:54.954 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:56:54.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:55.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.080+0000 7f2e2c2de640 1 Processor -- start 2024-09-15T22:56:55.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 -- start start 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2e2406d870 0x7f2e2406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 0x7f2e240d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2406e190 con 0x7f2e2415e820 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f2e240d2ba0 con 0x7f2e2406d870 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2c2de640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2e240d2e80 con 0x7f2e240b3610 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a07a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2e2406d870 0x7f2e2406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e29879640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2e2415e820 0x7f2e240cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56420/0 (socket says 172.21.15.28:56420) 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e29879640 1 -- 172.21.15.28:0/345479956 learned_addr learned my addr 172.21.15.28:0/345479956 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a87b640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 0x7f2e240d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a07a640 1 -- 172.21.15.28:0/345479956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 msgr2=0x7f2e240d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a07a640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 0x7f2e240d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a07a640 1 -- 172.21.15.28:0/345479956 >> v1:172.21.15.28:6789/0 conn(0x7f2e2415e820 legacy=0x7f2e240cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a07a640 1 -- 172.21.15.28:0/345479956 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e240d3160 con 0x7f2e2406d870 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e29078640 1 -- 172.21.15.28:0/345479956 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078106915 0 0) 0x7f2e2406e190 con 0x7f2e2415e820 2024-09-15T22:56:55.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.084+0000 7f2e2a87b640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 0x7f2e240d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:55.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2a07a640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e2406d870 0x7f2e2406dc50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e200097c0 tx=0x7f2e2001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ca7cd3ca6bab02 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e29078640 1 -- 172.21.15.28:0/345479956 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e200aa5f0 con 0x7f2e2406d870 2024-09-15T22:56:55.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e29078640 1 -- 172.21.15.28:0/345479956 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e200af070 con 0x7f2e2406d870 2024-09-15T22:56:55.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e29078640 1 -- 172.21.15.28:0/345479956 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e200aa9b0 con 0x7f2e2406d870 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- 172.21.15.28:0/345479956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e2406d870 msgr2=0x7f2e2406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e2406d870 0x7f2e2406dc50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e200097c0 tx=0x7f2e2001c470 comp rx=0 tx=0).stop 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- 172.21.15.28:0/345479956 shutdown_connections 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e240b3610 0x7f2e240d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/345479956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e2406d870 0x7f2e2406dc50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- 172.21.15.28:0/345479956 >> 172.21.15.28:0/345479956 conn(0x7f2e240d4910 msgr2=0x7f2e240d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- 172.21.15.28:0/345479956 shutdown_connections 2024-09-15T22:56:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- 172.21.15.28:0/345479956 wait complete. 2024-09-15T22:56:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 Processor -- start 2024-09-15T22:56:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.088+0000 7f2e2c2de640 1 -- start start 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2406d870 0x7f2e24150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2415e820 0x7f2e24157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2416b530 con 0x7f2e240b3610 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2416b3b0 con 0x7f2e2415e820 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2416b6b0 con 0x7f2e2406d870 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50294/0 (socket says 172.21.15.28:50294) 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 -- 172.21.15.28:0/4196387615 learned_addr learned my addr 172.21.15.28:0/4196387615 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 -- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2406d870 msgr2=0x7f2e24150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2406d870 0x7f2e24150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 -- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2415e820 msgr2=0x7f2e24157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2a87b640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2415e820 0x7f2e24157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2415e820 0x7f2e24157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 -- 172.21.15.28:0/4196387615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e24151480 con 0x7f2e240b3610 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e29879640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c480 tx=0x7f2e1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14018070 con 0x7f2e240b3610 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14007500 con 0x7f2e240b3610 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14004a30 con 0x7f2e240b3610 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2415a0a0 con 0x7f2e240b3610 2024-09-15T22:56:55.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2415a660 con 0x7f2e240b3610 2024-09-15T22:56:55.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e240d3c40 con 0x7f2e240b3610 2024-09-15T22:56:55.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e14004bd0 con 0x7f2e240b3610 2024-09-15T22:56:55.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 0x7f2e08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e2a07a640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 0x7f2e08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.092+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2e14084e20 con 0x7f2e240b3610 2024-09-15T22:56:55.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.096+0000 7f2e2a07a640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 0x7f2e08069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2e200ae000 tx=0x7f2e20004740 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.100+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e140559f0 con 0x7f2e240b3610 2024-09-15T22:56:55.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.296+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e240d4f40 con 0x7f2e240b3610 2024-09-15T22:56:55.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.296+0000 7f2e1affd640 1 -- 172.21.15.28:0/4196387615 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f2e140552f0 con 0x7f2e240b3610 2024-09-15T22:56:55.300 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:55.300 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:55.301 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:55.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 msgr2=0x7f2e08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 0x7f2e08069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2e200ae000 tx=0x7f2e20004740 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 msgr2=0x7f2e2415ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c480 tx=0x7f2e1400c940 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 shutdown_connections 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2e080678c0 0x7f2e08069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2415e820 0x7f2e24157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2e240b3610 0x7f2e2415ec50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 --2- 172.21.15.28:0/4196387615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2406d870 0x7f2e24150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 >> 172.21.15.28:0/4196387615 conn(0x7f2e240d4910 msgr2=0x7f2e240b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 shutdown_connections 2024-09-15T22:56:55.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.300+0000 7f2e2c2de640 1 -- 172.21.15.28:0/4196387615 wait complete. 2024-09-15T22:56:55.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:55.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 Processor -- start 2024-09-15T22:56:55.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 -- start start 2024-09-15T22:56:55.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf200b5200 0x7fcf2015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200cca90 0x7fcf200b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf200b55e0 con 0x7fcf200b1dc0 2024-09-15T22:56:55.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcf200ce3b0 con 0x7fcf200b5200 2024-09-15T22:56:55.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf2598d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2015c5f0 con 0x7fcf200cca90 2024-09-15T22:56:55.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1e7fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200cca90 0x7fcf200b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf200b5200 0x7fcf2015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcf200b1dc0 0x7fcf200b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:51844/0 (socket says 172.21.15.28:51844) 2024-09-15T22:56:55.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf200b5200 0x7fcf2015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:52482/0 (socket says 172.21.15.28:52482) 2024-09-15T22:56:55.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1f7fe640 1 -- 172.21.15.28:0/1422764501 learned_addr learned my addr 172.21.15.28:0/1422764501 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:55.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 -- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200cca90 msgr2=0x7fcf200b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 --2- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200cca90 0x7fcf200b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 -- 172.21.15.28:0/1422764501 >> v1:172.21.15.131:6789/0 conn(0x7fcf200b1dc0 legacy=0x7fcf200b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.424+0000 7fcf1effd640 1 -- 172.21.15.28:0/1422764501 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf200b4910 con 0x7fcf200b5200 2024-09-15T22:56:55.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf1effd640 1 --2- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf2015c0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf100097f0 tx=0x7fcf1001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2b8a1d3643649a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf1dffb640 1 -- 172.21.15.28:0/1422764501 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf100b0070 con 0x7fcf200b5200 2024-09-15T22:56:55.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf1dffb640 1 -- 172.21.15.28:0/1422764501 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf100ab600 con 0x7fcf200b5200 2024-09-15T22:56:55.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf1dffb640 1 -- 172.21.15.28:0/1422764501 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf100ab9d0 con 0x7fcf200b5200 2024-09-15T22:56:55.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 -- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 msgr2=0x7fcf2015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf2015c0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf100097f0 tx=0x7fcf1001c410 comp rx=0 tx=0).stop 2024-09-15T22:56:55.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 -- 172.21.15.28:0/1422764501 shutdown_connections 2024-09-15T22:56:55.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200cca90 0x7fcf200b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1422764501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf2015c0b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 -- 172.21.15.28:0/1422764501 >> 172.21.15.28:0/1422764501 conn(0x7fcf2006bcc0 msgr2=0x7fcf2006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 -- 172.21.15.28:0/1422764501 shutdown_connections 2024-09-15T22:56:55.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.428+0000 7fcf2598d640 1 -- 172.21.15.28:0/1422764501 wait complete. 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 Processor -- start 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- start start 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200b1dc0 0x7fcf2014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf200710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200b4070 con 0x7fcf200cca90 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200cd8c0 con 0x7fcf200b5200 2024-09-15T22:56:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf200b25e0 con 0x7fcf200b1dc0 2024-09-15T22:56:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50310/0 (socket says 172.21.15.28:50310) 2024-09-15T22:56:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 -- 172.21.15.28:0/1877120032 learned_addr learned my addr 172.21.15.28:0/1877120032 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1e7fc640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf200710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1effd640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200b1dc0 0x7fcf2014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 -- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200b1dc0 msgr2=0x7fcf2014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200b1dc0 0x7fcf2014ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 -- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 msgr2=0x7fcf200710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf200710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 -- 172.21.15.28:0/1877120032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf20150110 con 0x7fcf200cca90 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf1f7fe640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800caa0 tx=0x7fcf1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18017070 con 0x7fcf200cca90 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1800ab40 con 0x7fcf200cca90 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf201503f0 con 0x7fcf200cca90 2024-09-15T22:56:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18012400 con 0x7fcf200cca90 2024-09-15T22:56:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf201509b0 con 0x7fcf200cca90 2024-09-15T22:56:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.432+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf20155290 con 0x7fcf200cca90 2024-09-15T22:56:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.436+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf1801a070 con 0x7fcf200cca90 2024-09-15T22:56:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.436+0000 7fcf07fff640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 0x7fcf0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.436+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf18085880 con 0x7fcf200cca90 2024-09-15T22:56:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.436+0000 7fcf1effd640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 0x7fcf0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.436+0000 7fcf1effd640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 0x7fcf0c069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf100ad000 tx=0x7fcf100a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.440+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf18055e00 con 0x7fcf200cca90 2024-09-15T22:56:55.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.632+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf200b37a0 con 0x7fcf200cca90 2024-09-15T22:56:55.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.632+0000 7fcf07fff640 1 -- 172.21.15.28:0/1877120032 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fcf1805a100 con 0x7fcf200cca90 2024-09-15T22:56:55.636 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:55.636 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:55.637 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:55.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 msgr2=0x7fcf0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 0x7fcf0c069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcf100ad000 tx=0x7fcf100a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:55.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 msgr2=0x7fcf200715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800caa0 tx=0x7fcf1800cf60 comp rx=0 tx=0).stop 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 shutdown_connections 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf200cca90 0x7fcf200715e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcf0c0678c0 0x7fcf0c069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf200b5200 0x7fcf200710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 --2- 172.21.15.28:0/1877120032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf200b1dc0 0x7fcf2014ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 >> 172.21.15.28:0/1877120032 conn(0x7fcf2006bcc0 msgr2=0x7fcf2015d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 shutdown_connections 2024-09-15T22:56:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.636+0000 7fcf2598d640 1 -- 172.21.15.28:0/1877120032 wait complete. 2024-09-15T22:56:55.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.772+0000 7fd2d351e640 1 Processor -- start 2024-09-15T22:56:55.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.772+0000 7fd2d351e640 1 -- start start 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d351e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2cc06d870 0x7fd2cc06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d351e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 0x7fd2cc0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d351e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2cc06e190 con 0x7fd2cc0b3610 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d351e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0d2ba0 con 0x7fd2cc06d870 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d351e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d2e80 con 0x7fd2cc15e820 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d1abb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd2cc0b3610 0x7fd2cc0d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56424/0 (socket says 172.21.15.28:56424) 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d1abb640 1 -- 172.21.15.28:0/3796238722 learned_addr learned my addr 172.21.15.28:0/3796238722 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/3796238722 >> v2:172.21.15.131:3300/0 conn(0x7fd2cc06d870 0x7fd2cc06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 0x7fd2cc0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347384017 0 0) 0x7fd2cc06e190 con 0x7fd2cc0b3610 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2b8003530 con 0x7fd2cc0b3610 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2538752148 0 0) 0x7fd2b8003530 con 0x7fd2cc0b3610 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 msgr2=0x7fd2cc0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 0x7fd2cc0cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 >> v2:172.21.15.131:3300/0 conn(0x7fd2cc06d870 msgr2=0x7fd2cc06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 --2- 172.21.15.28:0/3796238722 >> v2:172.21.15.131:3300/0 conn(0x7fd2cc06d870 0x7fd2cc06dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc0d3160 con 0x7fd2cc0b3610 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd2c4001680 con 0x7fd2cc0b3610 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 >> v1:172.21.15.28:6789/0 conn(0x7fd2cc0b3610 legacy=0x7fd2cc0d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 0x7fd2b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d2ba0 con 0x7fd2b80039c0 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d2e80 con 0x7fd2b8004810 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b800ba00 con 0x7fd2cc15e820 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 -- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 msgr2=0x7fd2b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc15e820 0x7fd2b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 -- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b8004810 msgr2=0x7fd2b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d12ba640 1 -- 172.21.15.28:0/3796238722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b8003530 con 0x7fd2b80039c0 2024-09-15T22:56:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.776+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2b8003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fc0 tx=0x7fd2c801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f84d6cf368f7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80b2070 con 0x7fd2b80039c0 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c80a5bf0 con 0x7fd2b80039c0 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c3fff640 1 -- 172.21.15.28:0/3796238722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8009c10 con 0x7fd2b80039c0 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- 172.21.15.28:0/3796238722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 msgr2=0x7fd2b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 --2- 172.21.15.28:0/3796238722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2b8003de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009fc0 tx=0x7fd2c801ccc0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d1abb640 1 -- 172.21.15.28:0/3796238722 reap_dead start 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- 172.21.15.28:0/3796238722 shutdown_connections 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- 172.21.15.28:0/3796238722 >> 172.21.15.28:0/3796238722 conn(0x7fd2cc0d4910 msgr2=0x7fd2cc0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- 172.21.15.28:0/3796238722 shutdown_connections 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- 172.21.15.28:0/3796238722 wait complete. 2024-09-15T22:56:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 Processor -- start 2024-09-15T22:56:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- start start 2024-09-15T22:56:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0ac000 0x7fd2cc15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc1f4980 0x7fd2cc160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d4350 con 0x7fd2b80039c0 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d3720 con 0x7fd2cc0ac000 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d351e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0cf750 con 0x7fd2cc1f4980 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50338/0 (socket says 172.21.15.28:50338) 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 -- 172.21.15.28:0/712945980 learned_addr learned my addr 172.21.15.28:0/712945980 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d1abb640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc1f4980 0x7fd2cc160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0ac000 0x7fd2cc15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 -- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc1f4980 msgr2=0x7fd2cc160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc1f4980 0x7fd2cc160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 -- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0ac000 msgr2=0x7fd2cc15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0ac000 0x7fd2cc15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 -- 172.21.15.28:0/712945980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc15e330 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2d12ba640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2c801c730 tx=0x7fd2c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80b2040 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c80bd070 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.780+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80adc60 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc0cced0 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc0cd490 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc0cfb00 con 0x7fd2b80039c0 2024-09-15T22:56:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2c80c1410 con 0x7fd2b80039c0 2024-09-15T22:56:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2c1ffb640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 0x7fd2b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd2c8120570 con 0x7fd2b80039c0 2024-09-15T22:56:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 0x7fd2b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.784+0000 7fd2d0ab9640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 0x7fd2b0069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc06e540 tx=0x7fd2bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:55.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.788+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2c80169d0 con 0x7fd2b80039c0 2024-09-15T22:56:55.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.944+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2cc0b5430 con 0x7fd2b80039c0 2024-09-15T22:56:55.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2c1ffb640 1 -- 172.21.15.28:0/712945980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7fd2c80f11d0 con 0x7fd2b80039c0 2024-09-15T22:56:55.950 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:55.950 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 msgr2=0x7fd2b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 0x7fd2b0069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc06e540 tx=0x7fd2bc008040 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 msgr2=0x7fd2cc1f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2c801c730 tx=0x7fd2c8009750 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 shutdown_connections 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2cc1f4980 0x7fd2cc160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2b00678f0 0x7fd2b0069db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0ac000 0x7fd2cc15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 --2- 172.21.15.28:0/712945980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2b80039c0 0x7fd2cc1f50f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 >> 172.21.15.28:0/712945980 conn(0x7fd2cc0d4910 msgr2=0x7fd2cc0d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 shutdown_connections 2024-09-15T22:56:55.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:55.948+0000 7fd2d351e640 1 -- 172.21.15.28:0/712945980 wait complete. 2024-09-15T22:56:55.968 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:56:55.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:56.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.084+0000 7fea05183640 1 Processor -- start 2024-09-15T22:56:56.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.084+0000 7fea05183640 1 -- start start 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fea00145970 0x7fea000b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea000b2300 0x7fea000cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000d0190 0x7fea00072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fea000b2770 con 0x7fea00145970 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fea000d0f20 con 0x7fea000b2300 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fea05183640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fea000cd620 con 0x7fea000d0190 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fea00145970 0x7fea000b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fea00145970 0x7fea000b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50352/0 (socket says 172.21.15.28:50352) 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 -- 172.21.15.28:0/801504829 learned_addr learned my addr 172.21.15.28:0/801504829 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fe59c640 1 --2- 172.21.15.28:0/801504829 >> v2:172.21.15.131:3300/0 conn(0x7fea000b2300 0x7fea000cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9ff59e640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000d0190 0x7fea00072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 -- 172.21.15.28:0/801504829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000d0190 msgr2=0x7fea00072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000d0190 0x7fea00072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 -- 172.21.15.28:0/801504829 >> v2:172.21.15.131:3300/0 conn(0x7fea000b2300 msgr2=0x7fea000cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/801504829 >> v2:172.21.15.131:3300/0 conn(0x7fea000b2300 0x7fea000cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 -- 172.21.15.28:0/801504829 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000d0960 con 0x7fea00145970 2024-09-15T22:56:56.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea00145970 0x7fea000b1dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea000cd7a0 tx=0x7fe9f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28f5dda7a7ab502 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fdd9b640 1 -- 172.21.15.28:0/801504829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00ab600 con 0x7fea00145970 2024-09-15T22:56:56.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fdd9b640 1 -- 172.21.15.28:0/801504829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f00b0070 con 0x7fea00145970 2024-09-15T22:56:56.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.088+0000 7fe9fdd9b640 1 -- 172.21.15.28:0/801504829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00ab9c0 con 0x7fea00145970 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/801504829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea00145970 msgr2=0x7fea000b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea00145970 0x7fea000b1dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea000cd7a0 tx=0x7fe9f001c440 comp rx=0 tx=0).stop 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/801504829 shutdown_connections 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000d0190 0x7fea00072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- 172.21.15.28:0/801504829 >> v2:172.21.15.131:3300/0 conn(0x7fea000b2300 0x7fea000cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- 172.21.15.28:0/801504829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea00145970 0x7fea000b1dc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/801504829 >> 172.21.15.28:0/801504829 conn(0x7fea0006bcc0 msgr2=0x7fea0006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/801504829 shutdown_connections 2024-09-15T22:56:56.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/801504829 wait complete. 2024-09-15T22:56:56.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 Processor -- start 2024-09-15T22:56:56.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- start start 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000b2300 0x7fea001418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea00145970 0x7fea0013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea00145ed0 con 0x7fea000d0190 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fea00145d50 con 0x7fea00145970 2024-09-15T22:56:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fea000cdab0 con 0x7fea000b2300 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50362/0 (socket says 172.21.15.28:50362) 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 -- 172.21.15.28:0/3821218231 learned_addr learned my addr 172.21.15.28:0/3821218231 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000b2300 0x7fea001418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9ff59e640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea00145970 0x7fea0013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 -- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000b2300 msgr2=0x7fea001418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000b2300 0x7fea001418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 -- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea00145970 msgr2=0x7fea0013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea00145970 0x7fea0013fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 -- 172.21.15.28:0/3821218231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea000ae8b0 con 0x7fea000d0190 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9fe59c640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400d800 tx=0x7fe9f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400b6c0 con 0x7fea000d0190 2024-09-15T22:56:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f4019070 con 0x7fea000d0190 2024-09-15T22:56:56.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400ba60 con 0x7fea000d0190 2024-09-15T22:56:56.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea00141ed0 con 0x7fea000d0190 2024-09-15T22:56:56.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.092+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea000b4a10 con 0x7fea000d0190 2024-09-15T22:56:56.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea00072220 con 0x7fea000d0190 2024-09-15T22:56:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9f400bc00 con 0x7fea000d0190 2024-09-15T22:56:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fe9e77fe640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 0x7fe9ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f4086110 con 0x7fea000d0190 2024-09-15T22:56:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 0x7fe9ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.096+0000 7fe9fed9d640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 0x7fe9ec069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00af000 tx=0x7fe9f00a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.100+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9f4056c40 con 0x7fea000d0190 2024-09-15T22:56:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.296+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea000b5210 con 0x7fea000d0190 2024-09-15T22:56:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.296+0000 7fe9e77fe640 1 -- 172.21.15.28:0/3821218231 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fe9f4056540 con 0x7fea000d0190 2024-09-15T22:56:56.300 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:56.300 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:56.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 msgr2=0x7fe9ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 0x7fe9ec069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00af000 tx=0x7fe9f00a7000 comp rx=0 tx=0).stop 2024-09-15T22:56:56.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 msgr2=0x7fea001591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400d800 tx=0x7fe9f400dcc0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 shutdown_connections 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9ec0678c0 0x7fe9ec069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea00145970 0x7fea0013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea000d0190 0x7fea001591c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 --2- 172.21.15.28:0/3821218231 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea000b2300 0x7fea001418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 >> 172.21.15.28:0/3821218231 conn(0x7fea0006bcc0 msgr2=0x7fea000b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 shutdown_connections 2024-09-15T22:56:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.300+0000 7fea05183640 1 -- 172.21.15.28:0/3821218231 wait complete. 2024-09-15T22:56:56.317 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:56:56.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.424+0000 7fe28e6a2640 1 Processor -- start 2024-09-15T22:56:56.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 -- start start 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe28806d870 0x7fe28806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe28815e820 0x7fe2880cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28806e190 con 0x7fe2880b3610 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880d2ba0 con 0x7fe28815e820 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe28e6a2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880d2e80 con 0x7fe28806d870 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe28815e820 0x7fe2880cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe28815e820 0x7fe2880cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50374/0 (socket says 172.21.15.28:50374) 2024-09-15T22:56:56.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 -- 172.21.15.28:0/1568308804 learned_addr learned my addr 172.21.15.28:0/1568308804 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe287fff640 1 --2- 172.21.15.28:0/1568308804 >> v2:172.21.15.131:3300/0 conn(0x7fe28806d870 0x7fe28806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 -- 172.21.15.28:0/1568308804 >> v2:172.21.15.131:3300/0 conn(0x7fe28806d870 msgr2=0x7fe28806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:56.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 --2- 172.21.15.28:0/1568308804 >> v2:172.21.15.131:3300/0 conn(0x7fe28806d870 0x7fe28806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 -- 172.21.15.28:0/1568308804 >> v1:172.21.15.131:6789/0 conn(0x7fe2880b3610 legacy=0x7fe2880d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:56.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.428+0000 7fe2877fe640 1 -- 172.21.15.28:0/1568308804 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880d3160 con 0x7fe28815e820 2024-09-15T22:56:56.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe2877fe640 1 --2- 172.21.15.28:0/1568308804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe2880cf750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe2880505a0 tx=0x7fe27001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea649e6b3ef62d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe286ffd640 1 -- 172.21.15.28:0/1568308804 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700a6040 con 0x7fe28815e820 2024-09-15T22:56:56.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe286ffd640 1 -- 172.21.15.28:0/1568308804 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700af070 con 0x7fe28815e820 2024-09-15T22:56:56.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe286ffd640 1 -- 172.21.15.28:0/1568308804 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700aa860 con 0x7fe28815e820 2024-09-15T22:56:56.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/1568308804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 msgr2=0x7fe2880cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/1568308804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe2880cf750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe2880505a0 tx=0x7fe27001c4e0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/1568308804 shutdown_connections 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/1568308804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe2880cf750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/1568308804 >> v2:172.21.15.131:3300/0 conn(0x7fe28806d870 0x7fe28806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/1568308804 >> 172.21.15.28:0/1568308804 conn(0x7fe2880d4910 msgr2=0x7fe2880d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/1568308804 shutdown_connections 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/1568308804 wait complete. 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 Processor -- start 2024-09-15T22:56:56.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- start start 2024-09-15T22:56:56.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe28806d870 0x7fe2880c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2880b3610 0x7fe288155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe28816b1a0 con 0x7fe28815e820 2024-09-15T22:56:56.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2880d4350 con 0x7fe2880b3610 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe28816b320 con 0x7fe28806d870 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50378/0 (socket says 172.21.15.28:50378) 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 -- 172.21.15.28:0/3942927449 learned_addr learned my addr 172.21.15.28:0/3942927449 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe287fff640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe28806d870 0x7fe2880c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe2877fe640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2880b3610 0x7fe288155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 -- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe28806d870 msgr2=0x7fe2880c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe28806d870 0x7fe2880c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 -- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2880b3610 msgr2=0x7fe288155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2880b3610 0x7fe288155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 -- 172.21.15.28:0/3942927449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880cca50 con 0x7fe28815e820 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28cc3f640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c780 tx=0x7fe28000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280004b70 con 0x7fe28815e820 2024-09-15T22:56:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe280004d10 con 0x7fe28815e820 2024-09-15T22:56:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2880ccd30 con 0x7fe28815e820 2024-09-15T22:56:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28000aa90 con 0x7fe28815e820 2024-09-15T22:56:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.432+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2880cd2f0 con 0x7fe28815e820 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28806dc50 con 0x7fe28815e820 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe28000ac30 con 0x7fe28815e820 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe284ff9640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 0x7fe268069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe280086240 con 0x7fe28815e820 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe287fff640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 0x7fe268069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.436+0000 7fe287fff640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 0x7fe268069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe278009790 tx=0x7fe278008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.440+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe280056d80 con 0x7fe28815e820 2024-09-15T22:56:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2880b9c60 con 0x7fe28815e820 2024-09-15T22:56:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe284ff9640 1 -- 172.21.15.28:0/3942927449 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fe280056680 con 0x7fe28815e820 2024-09-15T22:56:56.634 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:56.634 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"btime":"2024-09-15T22:56:24:018721+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1343498616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1343498616},{"type":"v1","addr":"172.21.15.28:6836","nonce":1343498616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1059322796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1059322796},{"type":"v1","addr":"172.21.15.28:6837","nonce":1059322796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3357254179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3357254179},{"type":"v1","addr":"172.21.15.131:6835","nonce":3357254179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:56:20.357916+0000","modified":"2024-09-15T22:56:23.380764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6834/41160339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":41160339},{"type":"v1","addr":"172.21.15.131:6834","nonce":41160339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-09-15T22:56:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-09-15T22:56:56.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 msgr2=0x7fe268069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 0x7fe268069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe278009790 tx=0x7fe278008040 comp rx=0 tx=0).stop 2024-09-15T22:56:56.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 msgr2=0x7fe28815fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c780 tx=0x7fe28000cc40 comp rx=0 tx=0).stop 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 shutdown_connections 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe28815e820 0x7fe28815fd80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe2680678c0 0x7fe268069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2880b3610 0x7fe288155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 --2- 172.21.15.28:0/3942927449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe28806d870 0x7fe2880c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 >> 172.21.15.28:0/3942927449 conn(0x7fe2880d4910 msgr2=0x7fe2880d4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 shutdown_connections 2024-09-15T22:56:56.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.632+0000 7fe28e6a2640 1 -- 172.21.15.28:0/3942927449 wait complete. 2024-09-15T22:56:56.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:56:56.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.772+0000 7ff23cb67640 1 Processor -- start 2024-09-15T22:56:56.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.772+0000 7ff23cb67640 1 -- start start 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23cb67640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff238145970 0x7ff2380b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23cb67640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff2380cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23cb67640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2380d0960 con 0x7ff2380d0190 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23cb67640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff2380d0f20 con 0x7ff238145970 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23cb67640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff2380cd620 con 0x7ff2380b2300 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff235d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff2380cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23659c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff238145970 0x7ff2380b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff235d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff2380cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43142/0 (socket says 172.21.15.28:43142) 2024-09-15T22:56:56.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff235d9b640 1 -- 172.21.15.28:0/1693916783 learned_addr learned my addr 172.21.15.28:0/1693916783 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23659c640 1 -- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 msgr2=0x7ff2380cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:56.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23659c640 1 --2- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff2380cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23659c640 1 -- 172.21.15.28:0/1693916783 >> v1:172.21.15.131:6789/0 conn(0x7ff2380d0190 legacy=0x7ff238072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.776+0000 7ff23659c640 1 -- 172.21.15.28:0/1693916783 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2380d0c40 con 0x7ff238145970 2024-09-15T22:56:56.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23659c640 1 --2- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff238145970 0x7ff2380b1dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097c0 tx=0x7ff22801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557f0e05bae87e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23559a640 1 -- 172.21.15.28:0/1693916783 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280b0070 con 0x7ff238145970 2024-09-15T22:56:56.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23559a640 1 -- 172.21.15.28:0/1693916783 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2280ab600 con 0x7ff238145970 2024-09-15T22:56:56.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23559a640 1 -- 172.21.15.28:0/1693916783 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab9d0 con 0x7ff238145970 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff238145970 msgr2=0x7ff2380b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 --2- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff238145970 0x7ff2380b1dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097c0 tx=0x7ff22801c410 comp rx=0 tx=0).stop 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- 172.21.15.28:0/1693916783 shutdown_connections 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 --2- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff2380cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 --2- 172.21.15.28:0/1693916783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff238145970 0x7ff2380b1dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- 172.21.15.28:0/1693916783 >> 172.21.15.28:0/1693916783 conn(0x7ff23806bcc0 msgr2=0x7ff23806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- 172.21.15.28:0/1693916783 shutdown_connections 2024-09-15T22:56:56.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- 172.21.15.28:0/1693916783 wait complete. 2024-09-15T22:56:56.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 Processor -- start 2024-09-15T22:56:56.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.780+0000 7ff23cb67640 1 -- start start 2024-09-15T22:56:56.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff23815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2380d0190 0x7ff238138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff238168fe0 con 0x7ff238145970 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff238168e60 con 0x7ff2380d0190 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff238169160 con 0x7ff2380b2300 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50388/0 (socket says 172.21.15.28:50388) 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 -- 172.21.15.28:0/550205390 learned_addr learned my addr 172.21.15.28:0/550205390 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23659c640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff23815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff235d9b640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2380d0190 0x7ff238138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 -- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 msgr2=0x7ff23815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff23815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 -- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2380d0190 msgr2=0x7ff238138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2380d0190 0x7ff238138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 -- 172.21.15.28:0/550205390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23813ee10 con 0x7ff238145970 2024-09-15T22:56:56.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff236d9d640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c730 tx=0x7ff23000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230003b80 con 0x7ff238145970 2024-09-15T22:56:56.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230003d20 con 0x7ff238145970 2024-09-15T22:56:56.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23000aa30 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23813f0f0 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23813f6b0 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2380cfc50 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff23000abd0 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 0x7ff218069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2300859f0 con 0x7ff238145970 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.784+0000 7ff23659c640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 0x7ff218069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:56.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.788+0000 7ff23659c640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 0x7ff218069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2280ad000 tx=0x7ff2280a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:56.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.792+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff230055ee0 con 0x7ff238145970 2024-09-15T22:56:56.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.952+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff238050050 con 0x7ff238145970 2024-09-15T22:56:56.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff226ffd640 1 -- 172.21.15.28:0/550205390 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16677 (secure 0 0 0) 0x7ff23005a1e0 con 0x7ff238145970 2024-09-15T22:56:56.957 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:56:56.957 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:56:21.997052+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:56:18.586931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:56:19.343111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 msgr2=0x7ff218069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 0x7ff218069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2280ad000 tx=0x7ff2280a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 msgr2=0x7ff23813dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c730 tx=0x7ff23000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 shutdown_connections 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff238145970 0x7ff23813dc70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff2180678c0 0x7ff218069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2380d0190 0x7ff238138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 --2- 172.21.15.28:0/550205390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2380b2300 0x7ff23815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 >> 172.21.15.28:0/550205390 conn(0x7ff23806bcc0 msgr2=0x7ff238142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:56.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 shutdown_connections 2024-09-15T22:56:56.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:56.956+0000 7ff23cb67640 1 -- 172.21.15.28:0/550205390 wait complete. 2024-09-15T22:56:56.974 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:56:57.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 Processor -- start 2024-09-15T22:56:57.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 -- start start 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e8c0b24d0 0x7f0e8c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e8c0d0190 0x7f0e8c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e8c0d0960 con 0x7f0e8c145970 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0e8c0d0f20 con 0x7f0e8c0d0190 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e90b25640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0e8c0cd620 con 0x7f0e8c0b24d0 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8ad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e8c0d0190 0x7f0e8c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8a59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0e8c145970 0x7f0e8c0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56434/0 (socket says 172.21.15.28:56434) 2024-09-15T22:56:57.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8a59c640 1 -- 172.21.15.28:0/3297520774 learned_addr learned my addr 172.21.15.28:0/3297520774 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e89d9b640 1 -- 172.21.15.28:0/3297520774 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041000970 0 0) 0x7f0e8c0d0960 con 0x7f0e8c145970 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e89d9b640 1 -- 172.21.15.28:0/3297520774 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e78003530 con 0x7f0e8c145970 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e83fff640 1 --2- 172.21.15.28:0/3297520774 >> v2:172.21.15.131:3300/0 conn(0x7f0e8c0b24d0 0x7f0e8c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/3297520774 >> v2:172.21.15.131:3300/0 conn(0x7f0e8c0b24d0 msgr2=0x7f0e8c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8ad9d640 1 --2- 172.21.15.28:0/3297520774 >> v2:172.21.15.131:3300/0 conn(0x7f0e8c0b24d0 0x7f0e8c0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/3297520774 >> v1:172.21.15.28:6789/0 conn(0x7f0e8c145970 legacy=0x7f0e8c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.092+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/3297520774 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c0d0c40 con 0x7f0e8c0d0190 2024-09-15T22:56:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e8ad9d640 1 --2- 172.21.15.28:0/3297520774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c0cdab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0afd50 tx=0x7f0e8401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefa856006ae128c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e89d9b640 1 -- 172.21.15.28:0/3297520774 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e840b2070 con 0x7f0e8c0d0190 2024-09-15T22:56:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e89d9b640 1 -- 172.21.15.28:0/3297520774 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e840a58c0 con 0x7f0e8c0d0190 2024-09-15T22:56:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e89d9b640 1 -- 172.21.15.28:0/3297520774 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e840a5c90 con 0x7f0e8c0d0190 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- 172.21.15.28:0/3297520774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c0d0190 msgr2=0x7f0e8c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 --2- 172.21.15.28:0/3297520774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c0cdab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0afd50 tx=0x7f0e8401c870 comp rx=0 tx=0).stop 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- 172.21.15.28:0/3297520774 shutdown_connections 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 --2- 172.21.15.28:0/3297520774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c0cdab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 --2- 172.21.15.28:0/3297520774 >> v2:172.21.15.131:3300/0 conn(0x7f0e8c0b24d0 0x7f0e8c0cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- 172.21.15.28:0/3297520774 >> 172.21.15.28:0/3297520774 conn(0x7f0e8c06bcc0 msgr2=0x7f0e8c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- 172.21.15.28:0/3297520774 shutdown_connections 2024-09-15T22:56:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- 172.21.15.28:0/3297520774 wait complete. 2024-09-15T22:56:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 Processor -- start 2024-09-15T22:56:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.096+0000 7f0e90b25640 1 -- start start 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e8c0b24d0 0x7f0e8c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c13dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c0ce980 con 0x7f0e8c145970 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c0ce800 con 0x7f0e8c0d0190 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0e8c0ceb00 con 0x7f0e8c0b24d0 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50396/0 (socket says 172.21.15.28:50396) 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/2897929145 learned_addr learned my addr 172.21.15.28:0/2897929145 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e8c0b24d0 msgr2=0x7f0e8c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e8c0b24d0 0x7f0e8c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c0d0190 msgr2=0x7f0e8c13dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e83fff640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c13dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c13dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 -- 172.21.15.28:0/2897929145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c15b700 con 0x7f0e8c145970 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8ad9d640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e840b0040 tx=0x7f0e84019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e840b2050 con 0x7f0e8c145970 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e840be070 con 0x7f0e8c145970 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e840ada90 con 0x7f0e8c145970 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c15b9e0 con 0x7f0e8c145970 2024-09-15T22:56:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c15bfa0 con 0x7f0e8c145970 2024-09-15T22:56:57.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8c0cfc50 con 0x7f0e8c145970 2024-09-15T22:56:57.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e840a5740 con 0x7f0e8c145970 2024-09-15T22:56:57.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 0x7f0e6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0e84120ea0 con 0x7f0e8c145970 2024-09-15T22:56:57.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8a59c640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 0x7f0e6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.100+0000 7f0e8a59c640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 0x7f0e6c069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c007fd0 tx=0x7f0e7c007900 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.104+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e84016520 con 0x7f0e8c145970 2024-09-15T22:56:57.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.304+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0e8c0cc3a0 con 0x7f0e8c145970 2024-09-15T22:56:57.305 INFO:tasks.ceph.mon.a.smithi028.stderr:2024-09-15T22:56:57.304+0000 7f45fbb49640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:56:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e82ffd640 1 -- 172.21.15.28:0/2897929145 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f0e840f1b00 con 0x7f0e8c145970 2024-09-15T22:56:57.308 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 msgr2=0x7f0e6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 0x7f0e6c069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c007fd0 tx=0x7f0e7c007900 comp rx=0 tx=0).stop 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 msgr2=0x7f0e8c0af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e840b0040 tx=0x7f0e84019610 comp rx=0 tx=0).stop 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 shutdown_connections 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e8c145970 0x7f0e8c0af910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0e6c0678c0 0x7f0e6c069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e8c0d0190 0x7f0e8c13dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 --2- 172.21.15.28:0/2897929145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e8c0b24d0 0x7f0e8c15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 >> 172.21.15.28:0/2897929145 conn(0x7f0e8c06bcc0 msgr2=0x7f0e8c0b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:57.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 shutdown_connections 2024-09-15T22:56:57.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.308+0000 7f0e90b25640 1 -- 172.21.15.28:0/2897929145 wait complete. 2024-09-15T22:56:57.322 INFO:tasks.ceph.mds.b.smithi131.stderr: -2315> 2024-09-15T22:56:26.302+0000 7f2d91d0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:56:57.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:56:57.372 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-15T22:56:57.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.448+0000 7f7cd5c14640 1 Processor -- start 2024-09-15T22:56:57.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.448+0000 7f7cd5c14640 1 -- start start 2024-09-15T22:56:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd015c610 0x7f7cd0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7cd00d3180 0x7f7cd00d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7cd00cd170 0x7f7cd00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd0161050 con 0x7f7cd00cd170 2024-09-15T22:56:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd015c9f0 con 0x7f7cd00d3180 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cd5c14640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00cf230 con 0x7f7cd015c610 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7cd00cd170 0x7f7cd00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7cd00cd170 0x7f7cd00d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50412/0 (socket says 172.21.15.28:50412) 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 -- 172.21.15.28:0/3391300453 learned_addr learned my addr 172.21.15.28:0/3391300453 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cc7fff640 1 --2- 172.21.15.28:0/3391300453 >> v2:172.21.15.131:3300/0 conn(0x7f7cd00d3180 0x7f7cd00d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccf7fe640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd015c610 0x7f7cd0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 -- 172.21.15.28:0/3391300453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd015c610 msgr2=0x7f7cd0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd015c610 0x7f7cd0160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 -- 172.21.15.28:0/3391300453 >> v2:172.21.15.131:3300/0 conn(0x7f7cd00d3180 msgr2=0x7f7cd00d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 --2- 172.21.15.28:0/3391300453 >> v2:172.21.15.131:3300/0 conn(0x7f7cd00d3180 0x7f7cd00d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 -- 172.21.15.28:0/3391300453 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00cf510 con 0x7f7cd00cd170 2024-09-15T22:56:57.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7ccffff640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd00cd170 0x7f7cd00d09c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7cd006efe0 tx=0x7f7cc801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5e66ce0beb04d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cceffd640 1 -- 172.21.15.28:0/3391300453 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80a5840 con 0x7f7cd00cd170 2024-09-15T22:56:57.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cceffd640 1 -- 172.21.15.28:0/3391300453 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc80a59e0 con 0x7f7cd00cd170 2024-09-15T22:56:57.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.452+0000 7f7cceffd640 1 -- 172.21.15.28:0/3391300453 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80a5db0 con 0x7f7cd00cd170 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/3391300453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd00cd170 msgr2=0x7f7cd00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd00cd170 0x7f7cd00d09c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7cd006efe0 tx=0x7f7cc801c9c0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/3391300453 shutdown_connections 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd00cd170 0x7f7cd00d09c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/3391300453 >> v2:172.21.15.131:3300/0 conn(0x7f7cd00d3180 0x7f7cd00d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/3391300453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd015c610 0x7f7cd0160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/3391300453 >> 172.21.15.28:0/3391300453 conn(0x7f7cd00d2580 msgr2=0x7f7cd00d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/3391300453 shutdown_connections 2024-09-15T22:56:57.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/3391300453 wait complete. 2024-09-15T22:56:57.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 Processor -- start 2024-09-15T22:56:57.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- start start 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 0x7f7cd00b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd00d3180 0x7f7cd006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00711b0 con 0x7f7cd015c610 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00cef30 con 0x7f7cd00cd170 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd0071330 con 0x7f7cd00d3180 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50414/0 (socket says 172.21.15.28:50414) 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 -- 172.21.15.28:0/2539208656 learned_addr learned my addr 172.21.15.28:0/2539208656 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cc7fff640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd00d3180 0x7f7cd006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccf7fe640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 0x7f7cd00b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 -- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd00d3180 msgr2=0x7f7cd006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd00d3180 0x7f7cd006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 -- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 msgr2=0x7f7cd00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 0x7f7cd00b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 -- 172.21.15.28:0/2539208656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd015a8b0 con 0x7f7cd015c610 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccf7fe640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 0x7f7cd00b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7ccffff640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80af040 tx=0x7f7cc8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80bc020 con 0x7f7cd015c610 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc80b8880 con 0x7f7cd015c610 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80b8c70 con 0x7f7cd015c610 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd006d1a0 con 0x7f7cd015c610 2024-09-15T22:56:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.456+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd006d440 con 0x7f7cd015c610 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd0071680 con 0x7f7cd015c610 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cc80bf020 con 0x7f7cd015c610 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7cccff9640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 0x7f7cb0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f7cc8120e20 con 0x7f7cd015c610 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7ccf7fe640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 0x7f7cb0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.460+0000 7f7ccf7fe640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 0x7f7cb0069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00b7900 tx=0x7f7cc0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:57.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.464+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7cc80c6030 con 0x7f7cd015c610 2024-09-15T22:56:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:57.664+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7cd00cc4b0 con 0x7f7cd015c610 2024-09-15T22:56:58.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.312+0000 7f7cccff9640 1 -- 172.21.15.28:0/2539208656 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f7cc80165e0 con 0x7f7cd015c610 2024-09-15T22:56:58.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 msgr2=0x7f7cb0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 0x7f7cb0069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00b7900 tx=0x7f7cc0008040 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 msgr2=0x7f7cd00cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80af040 tx=0x7f7cc8019760 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 shutdown_connections 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7cd015c610 0x7f7cd00cb870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7cd00d3180 0x7f7cd006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7cb00678f0 0x7f7cb0069db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 --2- 172.21.15.28:0/2539208656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cd00cd170 0x7f7cd00b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 >> 172.21.15.28:0/2539208656 conn(0x7f7cd00d2580 msgr2=0x7f7cd01488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 shutdown_connections 2024-09-15T22:56:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.316+0000 7f7cd5c14640 1 -- 172.21.15.28:0/2539208656 wait complete. 2024-09-15T22:56:58.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:56:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.468+0000 7f20ae751640 1 Processor -- start 2024-09-15T22:56:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.468+0000 7f20ae751640 1 -- start start 2024-09-15T22:56:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20ae751640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f20a815a060 0x7f20a80cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20ae751640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a80cccf0 con 0x7f20a80cf930 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20ae751640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a80ccfd0 con 0x7f20a815c9a0 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20ae751640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f20a815a440 con 0x7f20a815a060 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f20a815a060 0x7f20a80cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20accee640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f20a80cf930 0x7f20a815ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56442/0 (socket says 172.21.15.28:56442) 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20accee640 1 -- 172.21.15.28:0/3512989910 learned_addr learned my addr 172.21.15.28:0/3512989910 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a7fff640 1 -- 172.21.15.28:0/3512989910 >> v1:172.21.15.131:6789/0 conn(0x7f20a815c9a0 legacy=0x7f20a80cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a7fff640 1 -- 172.21.15.28:0/3512989910 >> v1:172.21.15.28:6789/0 conn(0x7f20a80cf930 legacy=0x7f20a815ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a7fff640 1 -- 172.21.15.28:0/3512989910 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a80cd2b0 con 0x7f20a815a060 2024-09-15T22:56:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a7fff640 1 --2- 172.21.15.28:0/3512989910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80cff90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097c0 tx=0x7f209c01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f8229eeb7422b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:58.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a6ffd640 1 -- 172.21.15.28:0/3512989910 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0b0070 con 0x7f20a815a060 2024-09-15T22:56:58.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a6ffd640 1 -- 172.21.15.28:0/3512989910 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0ab600 con 0x7f20a815a060 2024-09-15T22:56:58.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.472+0000 7f20a6ffd640 1 -- 172.21.15.28:0/3512989910 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0ab9d0 con 0x7f20a815a060 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/3512989910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 msgr2=0x7f20a80cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 --2- 172.21.15.28:0/3512989910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80cff90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097c0 tx=0x7f209c01c2f0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/3512989910 shutdown_connections 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 --2- 172.21.15.28:0/3512989910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80cff90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/3512989910 >> 172.21.15.28:0/3512989910 conn(0x7f20a806bcc0 msgr2=0x7f20a806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/3512989910 shutdown_connections 2024-09-15T22:56:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/3512989910 wait complete. 2024-09-15T22:56:58.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 Processor -- start 2024-09-15T22:56:58.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- start start 2024-09-15T22:56:58.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a80cf930 0x7f20a80af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20a815c9a0 0x7f20a8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f20a80ccaa0 con 0x7f20a815a060 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f20a80d04d0 con 0x7f20a80cf930 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f20a80d0650 con 0x7f20a815c9a0 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20accee640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20a815c9a0 0x7f20a8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a80cf930 0x7f20a80af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50418/0 (socket says 172.21.15.28:50418) 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 -- 172.21.15.28:0/1077590625 learned_addr learned my addr 172.21.15.28:0/1077590625 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 -- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20a815c9a0 msgr2=0x7f20a8154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20a815c9a0 0x7f20a8154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 -- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a80cf930 msgr2=0x7f20a80af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a80cf930 0x7f20a80af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 -- 172.21.15.28:0/1077590625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a80aee10 con 0x7f20a815a060 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a77fe640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f209800b410 tx=0x7f209800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098015030 con 0x7f20a815a060 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098004020 con 0x7f20a815a060 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098004450 con 0x7f20a815a060 2024-09-15T22:56:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a80ae290 con 0x7f20a815a060 2024-09-15T22:56:58.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.476+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a80ae850 con 0x7f20a815a060 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a8069220 con 0x7f20a815a060 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2098018070 con 0x7f20a815a060 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20a4ff9640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 0x7f2094069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f20980856b0 con 0x7f20a815a060 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20a7fff640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 0x7f2094069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.480+0000 7f20a7fff640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 0x7f2094069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ad000 tx=0x7f209c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:58.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.484+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20a80aee10 con 0x7f20a815a060 2024-09-15T22:56:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:58.648+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20a80cff90 con 0x7f20a815a060 2024-09-15T22:56:59.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.316+0000 7f20a4ff9640 1 -- 172.21.15.28:0/1077590625 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f2098055bd0 con 0x7f20a815a060 2024-09-15T22:56:59.319 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:56:59.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 msgr2=0x7f2094069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 0x7f2094069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ad000 tx=0x7f209c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 msgr2=0x7f20a80ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f209800b410 tx=0x7f209800b8d0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 shutdown_connections 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20a815c9a0 0x7f20a8154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20a815a060 0x7f20a80ada20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f20940678c0 0x7f2094069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 --2- 172.21.15.28:0/1077590625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20a80cf930 0x7f20a80af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.320+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 >> 172.21.15.28:0/1077590625 conn(0x7f20a806bcc0 msgr2=0x7f20a815dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:59.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.324+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 shutdown_connections 2024-09-15T22:56:59.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.324+0000 7f20ae751640 1 -- 172.21.15.28:0/1077590625 wait complete. 2024-09-15T22:56:59.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:56:59.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 Processor -- start 2024-09-15T22:56:59.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 -- start start 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41e80ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f41e80b5bf0 0x7f41e8162630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e80b6040 con 0x7f41e80cf950 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f41e80ce8d0 con 0x7f41e80b5bf0 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41edf88640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41e80b3c90 con 0x7f41e80cfd30 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f41e80cf950 0x7f41e8161f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56456/0 (socket says 172.21.15.28:56456) 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e77fe640 1 -- 172.21.15.28:0/3757804186 learned_addr learned my addr 172.21.15.28:0/3757804186 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41e80ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e7fff640 1 --2- 172.21.15.28:0/3757804186 >> v2:172.21.15.131:3300/0 conn(0x7f41e80b5bf0 0x7f41e8162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345006367 0 0) 0x7f41e80b6040 con 0x7f41e80cf950 2024-09-15T22:56:59.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.476+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0003530 con 0x7f41e80cf950 2024-09-15T22:56:59.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485428597 0 0) 0x7f41d0003530 con 0x7f41e80cf950 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 msgr2=0x7f41e80ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41e80ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 >> v2:172.21.15.131:3300/0 conn(0x7f41e80b5bf0 msgr2=0x7f41e8162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 --2- 172.21.15.28:0/3757804186 >> v2:172.21.15.131:3300/0 conn(0x7f41e80b5bf0 0x7f41e8162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e80b3f70 con 0x7f41e80cf950 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f41e0001a00 con 0x7f41e80cf950 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 >> v1:172.21.15.28:6789/0 conn(0x7f41e80cf950 legacy=0x7f41e8161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41d00039c0 0x7f41d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d0004810 0x7f41d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f41e80ce8d0 con 0x7f41d00039c0 2024-09-15T22:56:59.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41e80b3c90 con 0x7f41d0004810 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41d000ba00 con 0x7f41e80cfd30 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41d00039c0 0x7f41d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d0004810 0x7f41d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e7fff640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 -- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 msgr2=0x7f41d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 -- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d0004810 msgr2=0x7f41d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d0004810 0x7f41d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 -- 172.21.15.28:0/3757804186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0003530 con 0x7f41d00039c0 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41d0004810 0x7f41d0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:59.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e7fff640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41e80cfd30 0x7f41d00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41d00039c0 0x7f41d0003de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a880 tx=0x7f41e001d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62e622aa5a78bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e000a4a0 con 0x7f41d00039c0 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e00ad650 con 0x7f41d00039c0 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e67fc640 1 -- 172.21.15.28:0/3757804186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e00ada40 con 0x7f41d00039c0 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 -- 172.21.15.28:0/3757804186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41d00039c0 msgr2=0x7f41d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 --2- 172.21.15.28:0/3757804186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41d00039c0 0x7f41d0003de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a880 tx=0x7f41e001d310 comp rx=0 tx=0).stop 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41e7fff640 1 -- 172.21.15.28:0/3757804186 reap_dead start 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 -- 172.21.15.28:0/3757804186 shutdown_connections 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 -- 172.21.15.28:0/3757804186 >> 172.21.15.28:0/3757804186 conn(0x7f41e80b07d0 msgr2=0x7f41e80b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 -- 172.21.15.28:0/3757804186 shutdown_connections 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.480+0000 7f41edf88640 1 -- 172.21.15.28:0/3757804186 wait complete. 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 Processor -- start 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- start start 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d00039c0 0x7f41e815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41e8157b00 0x7f41e8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8162cf0 con 0x7f41e80ab7a0 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8162b70 con 0x7f41e8157b00 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41e815e450 con 0x7f41d00039c0 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50432/0 (socket says 172.21.15.28:50432) 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 -- 172.21.15.28:0/3620557104 learned_addr learned my addr 172.21.15.28:0/3620557104 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d00039c0 0x7f41e815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 -- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d00039c0 msgr2=0x7f41e815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e7fff640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41e8157b00 0x7f41e8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d00039c0 0x7f41e815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 -- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41e8157b00 msgr2=0x7f41e8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41e8157b00 0x7f41e8157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 -- 172.21.15.28:0/3620557104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e80ac220 con 0x7f41e80ab7a0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41e6ffd640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0108d0 tx=0x7f41dc010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00f040 con 0x7f41e80ab7a0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc004220 con 0x7f41e80ab7a0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00e960 con 0x7f41e80ab7a0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e80ac500 con 0x7f41e80ab7a0 2024-09-15T22:56:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e80acac0 con 0x7f41e80ab7a0 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.484+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e815e890 con 0x7f41e80ab7a0 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.488+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41dc00eb00 con 0x7f41e80ab7a0 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.488+0000 7f41cffff640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 0x7f41d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.488+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7f41dc085fe0 con 0x7f41e80ab7a0 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.488+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 0x7f41d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.488+0000 7f41e77fe640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 0x7f41d4069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ad000 tx=0x7f41e80d0710 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:59.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.492+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f41dc018030 con 0x7f41e80ab7a0 2024-09-15T22:56:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:56:59.648+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41e8158fd0 con 0x7f41e80ab7a0 2024-09-15T22:57:00.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.323+0000 7f41cffff640 1 -- 172.21.15.28:0/3620557104 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f41dc056c00 con 0x7f41e80ab7a0 2024-09-15T22:57:00.328 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 msgr2=0x7f41d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 0x7f41d4069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ad000 tx=0x7f41e80d0710 comp rx=0 tx=0).stop 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 msgr2=0x7f41e80abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0108d0 tx=0x7f41dc010d90 comp rx=0 tx=0).stop 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 shutdown_connections 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f41d40678f0 0x7f41d4069db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41e8157b00 0x7f41e8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41e80ab7a0 0x7f41e80abc20 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0108d0 tx=0x7f41dc010d90 comp rx=0 tx=0).stop 2024-09-15T22:57:00.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 --2- 172.21.15.28:0/3620557104 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41d00039c0 0x7f41e815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 >> 172.21.15.28:0/3620557104 conn(0x7f41e80b07d0 msgr2=0x7f41e8072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:00.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 shutdown_connections 2024-09-15T22:57:00.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.331+0000 7f41edf88640 1 -- 172.21.15.28:0/3620557104 wait complete. 2024-09-15T22:57:00.353 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:57:00.353 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:57:00.353 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:57:00.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:00.354 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:57:00.354 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:57:00.354 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:57:00.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:00.354 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:57:00.354 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:57:00.354 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:57:00.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:00.355 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:57:00.355 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:57:00.355 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:57:00.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:00.363 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:57:00.363 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:57:00.367 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:57:00.367 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:57:00.367 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:57:00.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:57:00.368 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:57:00.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:57:00.409 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:57:00.409 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:00.410 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:57:00.410 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:57:00.410 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:00.411 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:00.411 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:57:00.411 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:00.412 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:57:00.467 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2024-09-15T22:57:00.468 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2024-09-15T22:57:00.473 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-15T22:57:00.473 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-15T22:57:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 Processor -- start 2024-09-15T22:57:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 -- start start 2024-09-15T22:57:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 0x7fb14c0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c074180 con 0x7fb14c15e4f0 2024-09-15T22:57:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c1629c0 con 0x7fb14c15e110 2024-09-15T22:57:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1530cf640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c162ca0 con 0x7fb14c0b4a90 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb143fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb14c15e4f0 0x7fb14c0b4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56480/0 (socket says 172.21.15.28:56480) 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb143fff640 1 -- 172.21.15.28:0/3706516813 learned_addr learned my addr 172.21.15.28:0/3706516813 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb15166c640 1 --2- 172.21.15.28:0/3706516813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 0x7fb14c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712645207 0 0) 0x7fb14c074180 con 0x7fb14c15e4f0 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134003530 con 0x7fb14c15e4f0 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856841596 0 0) 0x7fb14c1629c0 con 0x7fb14c15e110 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb14c074180 con 0x7fb14c15e110 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb15166c640 1 -- 172.21.15.28:0/3706516813 >> v1:172.21.15.131:6789/0 conn(0x7fb14c15e110 legacy=0x7fb14c161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb15166c640 1 -- 172.21.15.28:0/3706516813 >> v1:172.21.15.28:6789/0 conn(0x7fb14c15e4f0 legacy=0x7fb14c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.519+0000 7fb15166c640 1 -- 172.21.15.28:0/3706516813 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c0d2470 con 0x7fb14c0b4a90 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb15166c640 1 --2- 172.21.15.28:0/3706516813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 0x7fb14c0d2f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d63cf3731f4265 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b2070 con 0x7fb14c0b4a90 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440a5a40 con 0x7fb14c0b4a90 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1437fe640 1 -- 172.21.15.28:0/3706516813 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440a5e10 con 0x7fb14c0b4a90 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- 172.21.15.28:0/3706516813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 msgr2=0x7fb14c0d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 --2- 172.21.15.28:0/3706516813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 0x7fb14c0d2f50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14401c960 comp rx=0 tx=0).stop 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- 172.21.15.28:0/3706516813 shutdown_connections 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 --2- 172.21.15.28:0/3706516813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c0b4a90 0x7fb14c0d2f50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- 172.21.15.28:0/3706516813 >> 172.21.15.28:0/3706516813 conn(0x7fb14c067a00 msgr2=0x7fb14c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- 172.21.15.28:0/3706516813 shutdown_connections 2024-09-15T22:57:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- 172.21.15.28:0/3706516813 wait complete. 2024-09-15T22:57:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 Processor -- start 2024-09-15T22:57:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- start start 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c0b4a90 0x7fb14c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c15e4f0 0x7fb14c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c06db80 con 0x7fb14c15e110 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c06da00 con 0x7fb14c0b4a90 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb1530cf640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c06dd00 con 0x7fb14c15e4f0 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb150e6b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c0b4a90 0x7fb14c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50456/0 (socket says 172.21.15.28:50456) 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 -- 172.21.15.28:0/1472639994 learned_addr learned my addr 172.21.15.28:0/1472639994 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb15166c640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c15e4f0 0x7fb14c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 -- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c15e4f0 msgr2=0x7fb14c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c15e4f0 0x7fb14c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 -- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c0b4a90 msgr2=0x7fb14c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c0b4a90 0x7fb14c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 -- 172.21.15.28:0/1472639994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c0d1080 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.523+0000 7fb143fff640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00c410 tx=0x7fb13c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c017070 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c005cf0 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c0cd690 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c007310 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c0cdc50 con 0x7fb14c15e110 2024-09-15T22:57:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c0d2f50 con 0x7fb14c15e110 2024-09-15T22:57:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb13c01a070 con 0x7fb14c15e110 2024-09-15T22:57:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7fb13c084e00 con 0x7fb14c15e110 2024-09-15T22:57:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb150e6b640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.527+0000 7fb150e6b640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1480017c0 tx=0x7fb148009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:00.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.531+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb13c0555d0 con 0x7fb14c15e110 2024-09-15T22:57:00.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:00.703+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb14c156bd0 con 0x7fb14c15e110 2024-09-15T22:57:01.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.343+0000 7fb1417fa640 1 -- 172.21.15.28:0/1472639994 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7fb13c0598d0 con 0x7fb14c15e110 2024-09-15T22:57:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 msgr2=0x7fb138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1480017c0 tx=0x7fb148009040 comp rx=0 tx=0).stop 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 msgr2=0x7fb14c0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00c410 tx=0x7fb13c00c8d0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 shutdown_connections 2024-09-15T22:57:01.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb14c15e4f0 0x7fb14c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb14c15e110 0x7fb14c0d0510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 --2- 172.21.15.28:0/1472639994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb14c0b4a90 0x7fb14c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 >> 172.21.15.28:0/1472639994 conn(0x7fb14c067a00 msgr2=0x7fb14c1615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 shutdown_connections 2024-09-15T22:57:01.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.347+0000 7fb1530cf640 1 -- 172.21.15.28:0/1472639994 wait complete. 2024-09-15T22:57:01.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:57:01.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 Processor -- start 2024-09-15T22:57:01.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 -- start start 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 0x7f6b480d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b4806bff0 0x7f6b4806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b480d2be0 con 0x7f6b480d33f0 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4806e710 con 0x7f6b4806bff0 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4e40e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b480d3160 con 0x7f6b48161ea0 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b4806bff0 0x7f6b4806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b4806bff0 0x7f6b4806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50470/0 (socket says 172.21.15.28:50470) 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 -- 172.21.15.28:0/4122369136 learned_addr learned my addr 172.21.15.28:0/4122369136 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 -- 172.21.15.28:0/4122369136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 msgr2=0x7f6b480d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b47fff640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 0x7f6b480d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 0x7f6b480d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 -- 172.21.15.28:0/4122369136 >> v1:172.21.15.131:6789/0 conn(0x7f6b480d33f0 legacy=0x7f6b480cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b4c9ab640 1 -- 172.21.15.28:0/4122369136 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4806e150 con 0x7f6b4806bff0 2024-09-15T22:57:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.499+0000 7f6b47fff640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 0x7f6b480d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4c9ab640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4806bff0 0x7f6b4806c4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009870 tx=0x7f6b4001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71ed22f947acf70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b46ffd640 1 -- 172.21.15.28:0/4122369136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400b2070 con 0x7f6b4806bff0 2024-09-15T22:57:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b46ffd640 1 -- 172.21.15.28:0/4122369136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400a9070 con 0x7f6b4806bff0 2024-09-15T22:57:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b46ffd640 1 -- 172.21.15.28:0/4122369136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400ad880 con 0x7f6b4806bff0 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- 172.21.15.28:0/4122369136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4806bff0 msgr2=0x7f6b4806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4806bff0 0x7f6b4806c4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009870 tx=0x7f6b4001c560 comp rx=0 tx=0).stop 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- 172.21.15.28:0/4122369136 shutdown_connections 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4806bff0 0x7f6b4806c4a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/4122369136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48161ea0 0x7f6b480d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- 172.21.15.28:0/4122369136 >> 172.21.15.28:0/4122369136 conn(0x7f6b480d1370 msgr2=0x7f6b480d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- 172.21.15.28:0/4122369136 shutdown_connections 2024-09-15T22:57:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- 172.21.15.28:0/4122369136 wait complete. 2024-09-15T22:57:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 Processor -- start 2024-09-15T22:57:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.503+0000 7f6b4e40e640 1 -- start start 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 0x7f6b4815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 0x7f6b48168530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b480b8180 con 0x7f6b480d33f0 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b480b8000 con 0x7f6b48161ea0 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b480b8300 con 0x7f6b4806bff0 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50476/0 (socket says 172.21.15.28:50476) 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 -- 172.21.15.28:0/411714414 learned_addr learned my addr 172.21.15.28:0/411714414 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b47fff640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 0x7f6b4815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4c9ab640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 0x7f6b48168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 -- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 msgr2=0x7f6b4815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 0x7f6b4815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 -- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 msgr2=0x7f6b48168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 0x7f6b48168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 -- 172.21.15.28:0/411714414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b48165d10 con 0x7f6b480d33f0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b47fff640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 0x7f6b4815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4c9ab640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 0x7f6b48168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b477fe640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c4d0 tx=0x7f6b3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c017070 con 0x7f6b480d33f0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0052d0 con 0x7f6b480d33f0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c003800 con 0x7f6b480d33f0 2024-09-15T22:57:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b48164c70 con 0x7f6b480d33f0 2024-09-15T22:57:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b48165230 con 0x7f6b480d33f0 2024-09-15T22:57:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4806c4a0 con 0x7f6b480d33f0 2024-09-15T22:57:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.507+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b3c01a070 con 0x7f6b480d33f0 2024-09-15T22:57:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.511+0000 7f6b44ff9640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 0x7f6b34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.511+0000 7f6b47fff640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 0x7f6b34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.511+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f6b3c084c10 con 0x7f6b480d33f0 2024-09-15T22:57:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.511+0000 7f6b47fff640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 0x7f6b34069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d430 tx=0x7f6b38007530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.515+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b3c005480 con 0x7f6b480d33f0 2024-09-15T22:57:01.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.743+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6b480b3c30 con 0x7f6b480d33f0 2024-09-15T22:57:01.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.743+0000 7f6b44ff9640 1 -- 172.21.15.28:0/411714414 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f6b3c0553c0 con 0x7f6b480d33f0 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm3VmBABAAvArGEMRHBqR4+onQhfvLWw==", 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.748 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmNvriDBAAOw+cBCCkpdgYizzytoLBqw==", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2024-09-15T22:57:01.749 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm+UhHCRAADCzYYFA/byDLhc0gyhKtjg==", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.d", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm/YYtFRAACfJwJbZMto9fuV3Cwwy17g==", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:01.750 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDWZedm0mjGLBAAgudL/qgd3Apx7aNMkuv1ew==", 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.751 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDZZedmJC4YOxAAYFJqOAKxORBJu/etCT0cug==", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDdZedm0NGqHxAAuo+sT8jTpNMk0Nn6e0asOw==", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.752 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDhZedmjcjJExAApX0Gy+AFj4agMJeTYEjlqw==", 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.753 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDnZedmOydVKhAAefigK6MQckJuqoT6uvgzng==", 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2024-09-15T22:57:01.754 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDqZedmum88ORAAmvNaB0qjP0GC7HsW6SSYlw==", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDuZedm8moZDhAANQOtbsX8obocRfT7T/7c8g==", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.755 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDxZedmYMjiGhAA+N2wn1W2iROVzEVPtN9EHw==", 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2024-09-15T22:57:01.756 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ==", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.1", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmEgz6IhAABJCMdbBOU5/r3vd3wgkbiw==", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.757 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.2", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmMXYkIBAA2gP9aTm1jv+VT40Ph7wqTw==", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.758 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.3", 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmRKojKBAAY3fDsqBeGseUKhWG5OymrA==", 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedmjkJ8JRAAa/NR6wFNQWNqCNKhKI9fdQ==", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mds", 2024-09-15T22:57:01.760 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmJWxZBBAAyPVfwfIkILjhLh9Bcfo+aw==", 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmW4xZBBAA2WBN/bG4L+HyjeU2W1gDmQ==", 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.761 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-osd", 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmuqlZBBAAcLnmuGsIZ1QI/fuV9GNJ2A==", 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmR8BZBBAAsxyCsV4DOQufLp3w2s1t9g==", 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.762 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmENdZBBAAiGpJUB9O8G+D6InYkEmWqQ==", 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD9ZedmM+9ZBBAA3ltV8NXfGnXs/5OGi5bJCA==", 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.763 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedmLRUPORAAaKVTRYkUjwpfJIdrQ3iXPw==", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedm/h5PNhAAHa2ueT90xSXDFYPKgX/z1A==", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2024-09-15T22:57:01.764 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:01.765 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.765 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:01.765 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-15T22:57:01.765 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 msgr2=0x7f6b34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 0x7f6b34069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d430 tx=0x7f6b38007530 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 msgr2=0x7f6b481645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c4d0 tx=0x7f6b3c00c990 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 shutdown_connections 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b340678f0 0x7f6b34069db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48161ea0 0x7f6b48168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b480d33f0 0x7f6b481645e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 --2- 172.21.15.28:0/411714414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b4806bff0 0x7f6b4815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 >> 172.21.15.28:0/411714414 conn(0x7f6b480d1370 msgr2=0x7f6b480b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:01.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 shutdown_connections 2024-09-15T22:57:01.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.747+0000 7f6b4e40e640 1 -- 172.21.15.28:0/411714414 wait complete. 2024-09-15T22:57:01.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T22:57:01.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 Processor -- start 2024-09-15T22:57:01.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 -- start start 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f213815b0a0 0x7f213806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f213806d310 0x7f21380cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21380d0000 con 0x7f21380cfb90 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f213806d750 con 0x7f213815b0a0 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213eb10640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f21380d0290 con 0x7f213806d310 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213c8ac640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f213815b0a0 0x7f213806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213c8ac640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f213815b0a0 0x7f213806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50478/0 (socket says 172.21.15.28:50478) 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f213c8ac640 1 -- 172.21.15.28:0/3617380858 learned_addr learned my addr 172.21.15.28:0/3617380858 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.891+0000 7f2137fff640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f213806d310 0x7f21380cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213c8ac640 1 -- 172.21.15.28:0/3617380858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f213806d310 msgr2=0x7f21380cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213c8ac640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f213806d310 0x7f21380cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213c8ac640 1 -- 172.21.15.28:0/3617380858 >> v1:172.21.15.131:6789/0 conn(0x7f21380cfb90 legacy=0x7f21380cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213c8ac640 1 -- 172.21.15.28:0/3617380858 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138071d30 con 0x7f213815b0a0 2024-09-15T22:57:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213c8ac640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213815b0a0 0x7f213806cdd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f212c00bb10 tx=0x7f212c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad84d0251f1a922 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f21377fe640 1 -- 172.21.15.28:0/3617380858 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c0b4070 con 0x7f213815b0a0 2024-09-15T22:57:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f21377fe640 1 -- 172.21.15.28:0/3617380858 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c0a7c70 con 0x7f213815b0a0 2024-09-15T22:57:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f21377fe640 1 -- 172.21.15.28:0/3617380858 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c0af660 con 0x7f213815b0a0 2024-09-15T22:57:01.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 -- 172.21.15.28:0/3617380858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213815b0a0 msgr2=0x7f213806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213815b0a0 0x7f213806cdd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f212c00bb10 tx=0x7f212c01eba0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 -- 172.21.15.28:0/3617380858 shutdown_connections 2024-09-15T22:57:01.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f213806d310 0x7f21380cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 --2- 172.21.15.28:0/3617380858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213815b0a0 0x7f213806cdd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 -- 172.21.15.28:0/3617380858 >> 172.21.15.28:0/3617380858 conn(0x7f21380cdbe0 msgr2=0x7f21380cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:01.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 -- 172.21.15.28:0/3617380858 shutdown_connections 2024-09-15T22:57:01.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.895+0000 7f213eb10640 1 -- 172.21.15.28:0/3617380858 wait complete. 2024-09-15T22:57:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 Processor -- start 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- start start 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21380cfb90 0x7f2138159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f213815b0a0 0x7f21380c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f213815b600 con 0x7f213806d310 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f213815b480 con 0x7f213815b0a0 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f213806bcc0 con 0x7f21380cfb90 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50494/0 (socket says 172.21.15.28:50494) 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 -- 172.21.15.28:0/1687966564 learned_addr learned my addr 172.21.15.28:0/1687966564 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f2137fff640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21380cfb90 0x7f2138159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213d0ad640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f213815b0a0 0x7f21380c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 -- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21380cfb90 msgr2=0x7f2138159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21380cfb90 0x7f2138159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 -- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f213815b0a0 msgr2=0x7f21380c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f213815b0a0 0x7f21380c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 -- 172.21.15.28:0/1687966564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21380c6ae0 con 0x7f213806d310 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213c8ac640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f212c01c7d0 tx=0x7f212c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c0bf070 con 0x7f213806d310 2024-09-15T22:57:01.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c0afce0 con 0x7f213806d310 2024-09-15T22:57:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21380cb030 con 0x7f213806d310 2024-09-15T22:57:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c0b4040 con 0x7f213806d310 2024-09-15T22:57:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21380cb310 con 0x7f213806d310 2024-09-15T22:57:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21380cf650 con 0x7f213806d310 2024-09-15T22:57:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.899+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f212c0c2070 con 0x7f213806d310 2024-09-15T22:57:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.903+0000 7f21357fa640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 0x7f211c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.903+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f212c11fbc0 con 0x7f213806d310 2024-09-15T22:57:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.903+0000 7f2137fff640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 0x7f211c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.903+0000 7f2137fff640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 0x7f211c069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21380cad50 tx=0x7f2124008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:01.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:01.907+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f212c0a7e20 con 0x7f213806d310 2024-09-15T22:57:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.131+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f21380b1200 con 0x7f213806d310 2024-09-15T22:57:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f21357fa640 1 -- 172.21.15.28:0/1687966564 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f212c018820 con 0x7f213806d310 2024-09-15T22:57:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 msgr2=0x7f211c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 0x7f211c069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21380cad50 tx=0x7f2124008040 comp rx=0 tx=0).stop 2024-09-15T22:57:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 msgr2=0x7f21381548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f212c01c7d0 tx=0x7f212c01b940 comp rx=0 tx=0).stop 2024-09-15T22:57:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 shutdown_connections 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f211c0678c0 0x7f211c069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f213815b0a0 0x7f21380c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21380cfb90 0x7f2138159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 --2- 172.21.15.28:0/1687966564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f213806d310 0x7f21381548f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 >> 172.21.15.28:0/1687966564 conn(0x7f21380cdbe0 msgr2=0x7f21380b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 shutdown_connections 2024-09-15T22:57:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.135+0000 7f213eb10640 1 -- 172.21.15.28:0/1687966564 wait complete. 2024-09-15T22:57:02.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T22:57:02.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 Processor -- start 2024-09-15T22:57:02.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 -- start start 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68145970 0x7faa680b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 0x7faa680cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa680d0190 0x7faa68072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7faa680d0f20 con 0x7faa680d0190 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa680cd620 con 0x7faa680b2300 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa70647640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa680b2740 con 0x7faa68145970 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa680d0190 0x7faa68072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa680d0190 0x7faa68072220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50496/0 (socket says 172.21.15.28:50496) 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 -- 172.21.15.28:0/2643391135 learned_addr learned my addr 172.21.15.28:0/2643391135 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6dbe2640 1 --2- 172.21.15.28:0/2643391135 >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 0x7faa680cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6e3e3640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68145970 0x7faa680b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 -- 172.21.15.28:0/2643391135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68145970 msgr2=0x7faa680b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68145970 0x7faa680b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 -- 172.21.15.28:0/2643391135 >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 msgr2=0x7faa680cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/2643391135 >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 0x7faa680cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 -- 172.21.15.28:0/2643391135 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa680d0960 con 0x7faa680d0190 2024-09-15T22:57:02.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6dbe2640 1 --2- 172.21.15.28:0/2643391135 >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 0x7faa680cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:02.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.275+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa680d0190 0x7faa68072220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faa680b5670 tx=0x7faa6001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ffbc3efb78b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6d3e1640 1 -- 172.21.15.28:0/2643391135 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600a57b0 con 0x7faa680d0190 2024-09-15T22:57:02.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6d3e1640 1 -- 172.21.15.28:0/2643391135 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600a5950 con 0x7faa680d0190 2024-09-15T22:57:02.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6d3e1640 1 -- 172.21.15.28:0/2643391135 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600a5d20 con 0x7faa680d0190 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- 172.21.15.28:0/2643391135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa680d0190 msgr2=0x7faa68072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa680d0190 0x7faa68072220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faa680b5670 tx=0x7faa6001c930 comp rx=0 tx=0).stop 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- 172.21.15.28:0/2643391135 shutdown_connections 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa680d0190 0x7faa68072220 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- 172.21.15.28:0/2643391135 >> v2:172.21.15.131:3300/0 conn(0x7faa680b2300 0x7faa680cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- 172.21.15.28:0/2643391135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68145970 0x7faa680b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- 172.21.15.28:0/2643391135 >> 172.21.15.28:0/2643391135 conn(0x7faa6806bcc0 msgr2=0x7faa6806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- 172.21.15.28:0/2643391135 shutdown_connections 2024-09-15T22:57:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- 172.21.15.28:0/2643391135 wait complete. 2024-09-15T22:57:02.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 Processor -- start 2024-09-15T22:57:02.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- start start 2024-09-15T22:57:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680b2300 0x7faa6813be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 0x7faa6815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa68145ed0 con 0x7faa68145970 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa68145d50 con 0x7faa680d0190 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa70647640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa680cda90 con 0x7faa680b2300 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6ebe4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6ebe4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50510/0 (socket says 172.21.15.28:50510) 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.279+0000 7faa6ebe4640 1 -- 172.21.15.28:0/1426783407 learned_addr learned my addr 172.21.15.28:0/1426783407 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6dbe2640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 0x7faa6815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6e3e3640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680b2300 0x7faa6813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 -- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680b2300 msgr2=0x7faa6813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680b2300 0x7faa6813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 -- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 msgr2=0x7faa6815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 0x7faa6815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 -- 172.21.15.28:0/1426783407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6815c830 con 0x7faa68145970 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6dbe2640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 0x7faa6815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6ebe4640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faa600af040 tx=0x7faa600196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600bc020 con 0x7faa68145970 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600b8880 con 0x7faa68145970 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa68138cf0 con 0x7faa68145970 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60009270 con 0x7faa68145970 2024-09-15T22:57:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa680cc890 con 0x7faa68145970 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa68072220 con 0x7faa68145970 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa600bf020 con 0x7faa68145970 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7faa60120af0 con 0x7faa68145970 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6e3e3640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.283+0000 7faa6e3e3640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 0x7faa4c069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa6400b740 tx=0x7faa64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.287+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa600c6030 con 0x7faa68145970 2024-09-15T22:57:02.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.515+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7faa6813f6a0 con 0x7faa68145970 2024-09-15T22:57:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.519+0000 7faa5effd640 1 -- 172.21.15.28:0/1426783407 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7faa600165e0 con 0x7faa68145970 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 msgr2=0x7faa4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 0x7faa4c069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa6400b740 tx=0x7faa64008040 comp rx=0 tx=0).stop 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 msgr2=0x7faa681387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faa600af040 tx=0x7faa600196d0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 shutdown_connections 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa68145970 0x7faa681387b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680d0190 0x7faa6815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 --2- 172.21.15.28:0/1426783407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680b2300 0x7faa6813be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 >> 172.21.15.28:0/1426783407 conn(0x7faa6806bcc0 msgr2=0x7faa680b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:02.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 shutdown_connections 2024-09-15T22:57:02.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.523+0000 7faa70647640 1 -- 172.21.15.28:0/1426783407 wait complete. 2024-09-15T22:57:02.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T22:57:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.651+0000 7f7b4f1a1640 1 Processor -- start 2024-09-15T22:57:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.651+0000 7f7b4f1a1640 1 -- start start 2024-09-15T22:57:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4f1a1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b480cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4f1a1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b480d0960 con 0x7f7b48145970 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4f1a1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b480d0c40 con 0x7f7b480d0190 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4f1a1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7b480d0f20 con 0x7f7b480b24d0 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7b48145970 0x7f7b480b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56490/0 (socket says 172.21.15.28:56490) 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 -- 172.21.15.28:0/117183564 learned_addr learned my addr 172.21.15.28:0/117183564 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260130256 0 0) 0x7f7b480d0960 con 0x7f7b48145970 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b30003530 con 0x7f7b48145970 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b47fff640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b480cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2905643743 0 0) 0x7f7b30003530 con 0x7f7b48145970 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 msgr2=0x7f7b480cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b480cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 >> v1:172.21.15.131:6789/0 conn(0x7f7b480d0190 legacy=0x7f7b480cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b480cd2b0 con 0x7f7b48145970 2024-09-15T22:57:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f7b3c001680 con 0x7f7b48145970 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 >> v1:172.21.15.28:6789/0 conn(0x7f7b48145970 legacy=0x7f7b480b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b300039f0 0x7f7b30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b480d0f20 con 0x7f7b300039f0 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30005560 con 0x7f7b30004810 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3000bf10 con 0x7f7b480b24d0 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b300039f0 0x7f7b30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b47fff640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4d73e640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 -- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 msgr2=0x7f7b3000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b480b24d0 0x7f7b3000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 -- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b30004810 msgr2=0x7f7b30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b4cf3d640 1 -- 172.21.15.28:0/117183564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b30003530 con 0x7f7b300039f0 2024-09-15T22:57:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.655+0000 7f7b47fff640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b30004810 0x7f7b30004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b300039f0 0x7f7b30003e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c1c0 tx=0x7f7b3c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e34de2e69118a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007d00 con 0x7f7b300039f0 2024-09-15T22:57:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0a9020 con 0x7f7b300039f0 2024-09-15T22:57:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b477fe640 1 -- 172.21.15.28:0/117183564 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c005b20 con 0x7f7b300039f0 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/117183564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b300039f0 msgr2=0x7f7b30003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/117183564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b300039f0 0x7f7b30003e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00c1c0 tx=0x7f7b3c01cc60 comp rx=0 tx=0).stop 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4d73e640 1 -- 172.21.15.28:0/117183564 reap_dead start 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/117183564 shutdown_connections 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/117183564 >> 172.21.15.28:0/117183564 conn(0x7f7b4806bcc0 msgr2=0x7f7b4806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/117183564 shutdown_connections 2024-09-15T22:57:02.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.659+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/117183564 wait complete. 2024-09-15T22:57:02.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 Processor -- start 2024-09-15T22:57:02.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- start start 2024-09-15T22:57:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b300039f0 0x7f7b4815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b48162140 0x7f7b481625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b480ced60 con 0x7f7b48143ec0 2024-09-15T22:57:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7b480cebe0 con 0x7f7b300039f0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7b48167e60 con 0x7f7b48162140 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50526/0 (socket says 172.21.15.28:50526) 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 -- 172.21.15.28:0/3885470327 learned_addr learned my addr 172.21.15.28:0/3885470327 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 -- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b48162140 msgr2=0x7f7b481625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b48162140 0x7f7b481625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 -- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b300039f0 msgr2=0x7f7b4815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b300039f0 0x7f7b4815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 -- 172.21.15.28:0/3885470327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4815c600 con 0x7f7b48143ec0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b47fff640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800f4f0 tx=0x7f7b3800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38018020 con 0x7f7b48143ec0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b38014870 con 0x7f7b48143ec0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38014c40 con 0x7f7b48143ec0 2024-09-15T22:57:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b48160a10 con 0x7f7b48143ec0 2024-09-15T22:57:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4815dc00 con 0x7f7b48143ec0 2024-09-15T22:57:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.663+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b480cdab0 con 0x7f7b48143ec0 2024-09-15T22:57:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.667+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b3801b020 con 0x7f7b48143ec0 2024-09-15T22:57:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.667+0000 7f7b457fa640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 0x7f7b34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.667+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f7b38085c90 con 0x7f7b48143ec0 2024-09-15T22:57:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.667+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 0x7f7b34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.667+0000 7f7b4cf3d640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 0x7f7b34069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0aa000 tx=0x7f7b480d0e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.671+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b38022020 con 0x7f7b48143ec0 2024-09-15T22:57:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.895+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7b48162b30 con 0x7f7b48143ec0 2024-09-15T22:57:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b457fa640 1 -- 172.21.15.28:0/3885470327 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f7b38024300 con 0x7f7b48143ec0 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 msgr2=0x7f7b34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 0x7f7b34069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0aa000 tx=0x7f7b480d0e10 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 msgr2=0x7f7b48160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800f4f0 tx=0x7f7b3800f8f0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 shutdown_connections 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b48162140 0x7f7b481625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b48143ec0 0x7f7b48160110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7b340678c0 0x7f7b34069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 --2- 172.21.15.28:0/3885470327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b300039f0 0x7f7b4815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 >> 172.21.15.28:0/3885470327 conn(0x7f7b4806bcc0 msgr2=0x7f7b480cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 shutdown_connections 2024-09-15T22:57:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:02.899+0000 7f7b4f1a1640 1 -- 172.21.15.28:0/3885470327 wait complete. 2024-09-15T22:57:02.920 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T22:57:03.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 Processor -- start 2024-09-15T22:57:03.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 -- start start 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53c015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53c00cca90 0x7f53c00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c00b55e0 con 0x7f53c00b1dc0 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00ce3b0 con 0x7f53c00cca90 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53c5427640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53c015c5f0 con 0x7f53c00b5200 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53bf7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f53c00b1dc0 0x7f53c00b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36904/0 (socket says 172.21.15.28:36904) 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53bf7fe640 1 -- 172.21.15.28:0/615574174 learned_addr learned my addr 172.21.15.28:0/615574174 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53beffd640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53c015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53b67fc640 1 --2- 172.21.15.28:0/615574174 >> v2:172.21.15.131:3300/0 conn(0x7f53c00cca90 0x7f53c00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587479413 0 0) 0x7f53c00b55e0 con 0x7f53c00b1dc0 2024-09-15T22:57:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.039+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ac003530 con 0x7f53c00b1dc0 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4237073614 0 0) 0x7f53ac003530 con 0x7f53c00b1dc0 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 msgr2=0x7f53c015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53c015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 >> v2:172.21.15.131:3300/0 conn(0x7f53c00cca90 msgr2=0x7f53c00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 --2- 172.21.15.28:0/615574174 >> v2:172.21.15.131:3300/0 conn(0x7f53c00cca90 0x7f53c00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00b4910 con 0x7f53c00b1dc0 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f53b8001a00 con 0x7f53c00b1dc0 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 >> v1:172.21.15.28:6789/0 conn(0x7f53c00b1dc0 legacy=0x7f53c00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53ac0039f0 0x7f53ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac004d50 0x7f53ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53c015c5f0 con 0x7f53ac0039f0 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac00b9d0 con 0x7f53ac004d50 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac00bb80 con 0x7f53c00b5200 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53ac0039f0 0x7f53ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53b67fc640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 -- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 msgr2=0x7f53ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00b5200 0x7f53ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 -- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac004d50 msgr2=0x7f53ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53bf7fe640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac004d50 0x7f53ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac004d50 0x7f53ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 -- 172.21.15.28:0/615574174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac003530 con 0x7f53ac0039f0 2024-09-15T22:57:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53bf7fe640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac004d50 0x7f53ac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53beffd640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53ac0039f0 0x7f53ac003e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f53b00093e0 tx=0x7f53b001eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6968051032aa5afd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00b4070 con 0x7f53ac0039f0 2024-09-15T22:57:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00a7680 con 0x7f53ac0039f0 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53be7fc640 1 -- 172.21.15.28:0/615574174 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00096b0 con 0x7f53ac0039f0 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 -- 172.21.15.28:0/615574174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53ac0039f0 msgr2=0x7f53ac003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 --2- 172.21.15.28:0/615574174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53ac0039f0 0x7f53ac003e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f53b00093e0 tx=0x7f53b001eca0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53bf7fe640 1 -- 172.21.15.28:0/615574174 reap_dead start 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 -- 172.21.15.28:0/615574174 shutdown_connections 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 -- 172.21.15.28:0/615574174 >> 172.21.15.28:0/615574174 conn(0x7f53c006bcc0 msgr2=0x7f53c006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 -- 172.21.15.28:0/615574174 shutdown_connections 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.043+0000 7f53c5427640 1 -- 172.21.15.28:0/615574174 wait complete. 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 Processor -- start 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- start start 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0039f0 0x7f53c01f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00d00c0 0x7f53c00d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00b4070 con 0x7f53c014bc70 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00cd8c0 con 0x7f53ac0039f0 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53c0158b70 con 0x7f53c00d00c0 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57730/0 (socket says 172.21.15.28:57730) 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 -- 172.21.15.28:0/3224955526 learned_addr learned my addr 172.21.15.28:0/3224955526 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53bf7fe640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00d00c0 0x7f53c00d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53beffd640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0039f0 0x7f53c01f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 -- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00d00c0 msgr2=0x7f53c00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00d00c0 0x7f53c00d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 -- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0039f0 msgr2=0x7f53c01f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0039f0 0x7f53c01f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 -- 172.21.15.28:0/3224955526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c014c0f0 con 0x7f53c014bc70 2024-09-15T22:57:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b67fc640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f53a8011660 tx=0x7f53a8011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a800f960 con 0x7f53c014bc70 2024-09-15T22:57:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a800fb00 con 0x7f53c014bc70 2024-09-15T22:57:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c00ac480 con 0x7f53c014bc70 2024-09-15T22:57:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8015460 con 0x7f53c014bc70 2024-09-15T22:57:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c00aca40 con 0x7f53c014bc70 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.047+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0158f90 con 0x7f53c014bc70 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.051+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53a8015600 con 0x7f53c014bc70 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.051+0000 7f53b7fff640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.051+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f53a80861a0 con 0x7f53c014bc70 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.051+0000 7f53beffd640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.051+0000 7f53beffd640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 0x7f53a0069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b1000 tx=0x7f53b00046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.055+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53a8019030 con 0x7f53c014bc70 2024-09-15T22:57:03.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.267+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f53c015f060 con 0x7f53c014bc70 2024-09-15T22:57:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.271+0000 7f53b7fff640 1 -- 172.21.15.28:0/3224955526 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f53a80570c0 con 0x7f53c014bc70 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 msgr2=0x7f53a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 0x7f53a0069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b1000 tx=0x7f53b00046d0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 msgr2=0x7f53c00af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f53a8011660 tx=0x7f53a8011b20 comp rx=0 tx=0).stop 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 shutdown_connections 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c00d00c0 0x7f53c00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014bc70 0x7f53c00af0c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 --2- 172.21.15.28:0/3224955526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0039f0 0x7f53c01f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 >> 172.21.15.28:0/3224955526 conn(0x7f53c006bcc0 msgr2=0x7f53c00b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 shutdown_connections 2024-09-15T22:57:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.275+0000 7f53c5427640 1 -- 172.21.15.28:0/3224955526 wait complete. 2024-09-15T22:57:03.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T22:57:03.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 Processor -- start 2024-09-15T22:57:03.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 -- start start 2024-09-15T22:57:03.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe8ac0b24d0 0x7fe8ac0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac0d0960 con 0x7fe8ac0d0190 2024-09-15T22:57:03.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac0d0c40 con 0x7fe8ac145970 2024-09-15T22:57:03.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b3295640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac0d0f20 con 0x7fe8ac0b24d0 2024-09-15T22:57:03.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1832640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe8ac0d0190 0x7fe8ac0cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36920/0 (socket says 172.21.15.28:36920) 2024-09-15T22:57:03.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1832640 1 -- 172.21.15.28:0/3823660460 learned_addr learned my addr 172.21.15.28:0/3823660460 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:03.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b0830640 1 --2- 172.21.15.28:0/3823660460 >> v2:172.21.15.131:3300/0 conn(0x7fe8ac0b24d0 0x7fe8ac0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229417324 0 0) 0x7fe8ac0d0960 con 0x7fe8ac0d0190 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe898003530 con 0x7fe8ac0d0190 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3875566331 0 0) 0x7fe898003530 con 0x7fe8ac0d0190 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 >> v2:172.21.15.131:3300/0 conn(0x7fe8ac0b24d0 msgr2=0x7fe8ac0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 --2- 172.21.15.28:0/3823660460 >> v2:172.21.15.131:3300/0 conn(0x7fe8ac0b24d0 0x7fe8ac0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 >> v1:172.21.15.131:6789/0 conn(0x7fe8ac145970 legacy=0x7fe8ac0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0cd2b0 con 0x7fe8ac0d0190 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fe8a4001a00 con 0x7fe8ac0d0190 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 >> v1:172.21.15.28:6789/0 conn(0x7fe8ac0d0190 legacy=0x7fe8ac0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 0x7fe898003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe898004810 0x7fe898004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe898005220 0x7fe89800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0d0f20 con 0x7fe8980039c0 2024-09-15T22:57:03.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe89800c150 con 0x7fe898005220 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe89800c350 con 0x7fe898004810 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 0x7fe898003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b0830640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe898004810 0x7fe898004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1832640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe898005220 0x7fe89800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 -- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe898004810 msgr2=0x7fe898004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe898004810 0x7fe898004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 -- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe898005220 msgr2=0x7fe89800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe898005220 0x7fe89800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1832640 1 -- 172.21.15.28:0/3823660460 reap_dead start 2024-09-15T22:57:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.415+0000 7fe8b1031640 1 -- 172.21.15.28:0/3823660460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe898003530 con 0x7fe8980039c0 2024-09-15T22:57:03.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 0x7fe898003e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8001780 tx=0x7fe8a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490a4d71e29d0a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80013a0 con 0x7fe8980039c0 2024-09-15T22:57:03.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a80052f0 con 0x7fe8980039c0 2024-09-15T22:57:03.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8a3fff640 1 -- 172.21.15.28:0/3823660460 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8003840 con 0x7fe8980039c0 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 -- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 msgr2=0x7fe898003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 0x7fe898003e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8001780 tx=0x7fe8a801c400 comp rx=0 tx=0).stop 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 -- 172.21.15.28:0/3823660460 shutdown_connections 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3823660460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8980039c0 0x7fe898003e00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 -- 172.21.15.28:0/3823660460 >> 172.21.15.28:0/3823660460 conn(0x7fe8ac06bcc0 msgr2=0x7fe8ac06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 -- 172.21.15.28:0/3823660460 shutdown_connections 2024-09-15T22:57:03.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.419+0000 7fe8b3295640 1 -- 172.21.15.28:0/3823660460 wait complete. 2024-09-15T22:57:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 Processor -- start 2024-09-15T22:57:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- start start 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 0x7fe8ac137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ac13f4a0 0x7fe8ac15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0b1f40 con 0x7fe8ac140c60 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0b1dc0 con 0x7fe8980039c0 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac0b20c0 con 0x7fe8ac13f4a0 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57742/0 (socket says 172.21.15.28:57742) 2024-09-15T22:57:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 -- 172.21.15.28:0/3239756386 learned_addr learned my addr 172.21.15.28:0/3239756386 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b0830640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ac13f4a0 0x7fe8ac15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 0x7fe8ac137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 -- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ac13f4a0 msgr2=0x7fe8ac15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ac13f4a0 0x7fe8ac15c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 -- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 msgr2=0x7fe8ac137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 0x7fe8ac137a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 -- 172.21.15.28:0/3239756386 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac13f9f0 con 0x7fe8ac140c60 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 0x7fe8ac137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1832640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac070630 tx=0x7fe8a4007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400ea40 con 0x7fe8ac140c60 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a4018070 con 0x7fe8ac140c60 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac141ca0 con 0x7fe8ac140c60 2024-09-15T22:57:03.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400ee40 con 0x7fe8ac140c60 2024-09-15T22:57:03.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac13eae0 con 0x7fe8ac140c60 2024-09-15T22:57:03.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac072960 con 0x7fe8ac140c60 2024-09-15T22:57:03.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8a401d460 con 0x7fe8ac140c60 2024-09-15T22:57:03.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 0x7fe890069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fe8a4085b90 con 0x7fe8ac140c60 2024-09-15T22:57:03.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.423+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 0x7fe890069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.427+0000 7fe8b1031640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 0x7fe890069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8001750 tx=0x7fe8a80011a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.427+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8a4056ab0 con 0x7fe8ac140c60 2024-09-15T22:57:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.643+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fe8ac0b1840 con 0x7fe8ac140c60 2024-09-15T22:57:03.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8a1ffb640 1 -- 172.21.15.28:0/3239756386 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fe8a40563b0 con 0x7fe8ac140c60 2024-09-15T22:57:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 msgr2=0x7fe890069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 0x7fe890069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8001750 tx=0x7fe8a80011a0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 msgr2=0x7fe8ac0ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac070630 tx=0x7fe8a4007b70 comp rx=0 tx=0).stop 2024-09-15T22:57:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 shutdown_connections 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8ac140c60 0x7fe8ac0ae8e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8ac13f4a0 0x7fe8ac15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe8900678f0 0x7fe890069db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 --2- 172.21.15.28:0/3239756386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8980039c0 0x7fe8ac137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 >> 172.21.15.28:0/3239756386 conn(0x7fe8ac06bcc0 msgr2=0x7fe8ac0cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 shutdown_connections 2024-09-15T22:57:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.647+0000 7fe8b3295640 1 -- 172.21.15.28:0/3239756386 wait complete. 2024-09-15T22:57:03.666 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T22:57:03.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 Processor -- start 2024-09-15T22:57:03.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 -- start start 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2c48073f10 0x7f2c480b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c480b48c0 0x7f2c4815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4815cf90 con 0x7f2c4815c280 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4815cd70 con 0x7f2c48073f10 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.783+0000 7f2c4f4a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2c480b4d20 con 0x7f2c480b48c0 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2c48073f10 0x7f2c480b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2c48073f10 0x7f2c480b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57752/0 (socket says 172.21.15.28:57752) 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 -- 172.21.15.28:0/742245440 learned_addr learned my addr 172.21.15.28:0/742245440 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:03.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4da42640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c480b48c0 0x7f2c4815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 -- 172.21.15.28:0/742245440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c480b48c0 msgr2=0x7f2c4815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c480b48c0 0x7f2c4815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 -- 172.21.15.28:0/742245440 >> v1:172.21.15.131:6789/0 conn(0x7f2c4815c280 legacy=0x7f2c4815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:03.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 -- 172.21.15.28:0/742245440 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4815d270 con 0x7f2c48073f10 2024-09-15T22:57:03.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4ca40640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c48073f10 0x7f2c480b4380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009870 tx=0x7f2c3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84f9884e211e5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c3ffff640 1 -- 172.21.15.28:0/742245440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380b0070 con 0x7f2c48073f10 2024-09-15T22:57:03.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c3ffff640 1 -- 172.21.15.28:0/742245440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c380ab600 con 0x7f2c48073f10 2024-09-15T22:57:03.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c3ffff640 1 -- 172.21.15.28:0/742245440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380ab9d0 con 0x7f2c48073f10 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/742245440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c48073f10 msgr2=0x7f2c480b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c48073f10 0x7f2c480b4380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009870 tx=0x7f2c3801c490 comp rx=0 tx=0).stop 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/742245440 shutdown_connections 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c480b48c0 0x7f2c4815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/742245440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c48073f10 0x7f2c480b4380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/742245440 >> 172.21.15.28:0/742245440 conn(0x7f2c48067a00 msgr2=0x7f2c48067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/742245440 shutdown_connections 2024-09-15T22:57:03.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.787+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/742245440 wait complete. 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 Processor -- start 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- start start 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c48073f10 0x7f2c480abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c480b48c0 0x7f2c480ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4815f190 con 0x7f2c4815c280 2024-09-15T22:57:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4815f010 con 0x7f2c480b48c0 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4815f310 con 0x7f2c48073f10 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57760/0 (socket says 172.21.15.28:57760) 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 -- 172.21.15.28:0/82777558 learned_addr learned my addr 172.21.15.28:0/82777558 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4d241640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c48073f10 0x7f2c480abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4ca40640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c480b48c0 0x7f2c480ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 -- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c48073f10 msgr2=0x7f2c480abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c48073f10 0x7f2c480abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 -- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c480b48c0 msgr2=0x7f2c480ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c480b48c0 0x7f2c480ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 -- 172.21.15.28:0/82777558 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48157cf0 con 0x7f2c4815c280 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4da42640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007e40 tx=0x7f2c4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40014620 con 0x7f2c4815c280 2024-09-15T22:57:03.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40019070 con 0x7f2c4815c280 2024-09-15T22:57:03.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40014a20 con 0x7f2c4815c280 2024-09-15T22:57:03.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c480ad0a0 con 0x7f2c4815c280 2024-09-15T22:57:03.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c480acdc0 con 0x7f2c4815c280 2024-09-15T22:57:03.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c480b4380 con 0x7f2c4815c280 2024-09-15T22:57:03.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c40014bc0 con 0x7f2c4815c280 2024-09-15T22:57:03.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 0x7f2c2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:03.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c4d241640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 0x7f2c2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:03.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.791+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f2c40086220 con 0x7f2c4815c280 2024-09-15T22:57:03.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.795+0000 7f2c4d241640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 0x7f2c2c069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b810 tx=0x7f2c44008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:03.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:03.799+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c40057090 con 0x7f2c4815c280 2024-09-15T22:57:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.011+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2c480b3d30 con 0x7f2c4815c280 2024-09-15T22:57:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.011+0000 7f2c3dffb640 1 -- 172.21.15.28:0/82777558 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f2c40056990 con 0x7f2c4815c280 2024-09-15T22:57:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 msgr2=0x7f2c2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 0x7f2c2c069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b810 tx=0x7f2c44008040 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 msgr2=0x7f2c481569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007e40 tx=0x7f2c4000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 shutdown_connections 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2c4815c280 0x7f2c481569c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f2c2c0678c0 0x7f2c2c069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c480b48c0 0x7f2c480ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 --2- 172.21.15.28:0/82777558 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c48073f10 0x7f2c480abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 >> 172.21.15.28:0/82777558 conn(0x7f2c48067a00 msgr2=0x7f2c4815b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 shutdown_connections 2024-09-15T22:57:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.015+0000 7f2c4f4a5640 1 -- 172.21.15.28:0/82777558 wait complete. 2024-09-15T22:57:04.035 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:57:04.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 Processor -- start 2024-09-15T22:57:04.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 -- start start 2024-09-15T22:57:04.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3900b5200 0x7fa39015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 0x7fa3900b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3900b55e0 con 0x7fa3900cca90 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa3900ce3b0 con 0x7fa3900b5200 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa394adb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa39015c5f0 con 0x7fa3900b1dc0 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa38dd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa3900cca90 0x7fa3900b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36928/0 (socket says 172.21.15.28:36928) 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa38dd9b640 1 -- 172.21.15.28:0/1547247731 learned_addr learned my addr 172.21.15.28:0/1547247731 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa38e59c640 1 --2- 172.21.15.28:0/1547247731 >> v2:172.21.15.131:3300/0 conn(0x7fa3900b5200 0x7fa39015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.151+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 0x7fa3900b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960919848 0 0) 0x7fa3900b55e0 con 0x7fa3900cca90 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa378003530 con 0x7fa3900cca90 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2829045510 0 0) 0x7fa378003530 con 0x7fa3900cca90 2024-09-15T22:57:04.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 msgr2=0x7fa3900b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 0x7fa3900b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 >> v2:172.21.15.131:3300/0 conn(0x7fa3900b5200 msgr2=0x7fa39015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 --2- 172.21.15.28:0/1547247731 >> v2:172.21.15.131:3300/0 conn(0x7fa3900b5200 0x7fa39015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3900cd020 con 0x7fa3900cca90 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fa384001680 con 0x7fa3900cca90 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 >> v1:172.21.15.28:6789/0 conn(0x7fa3900cca90 legacy=0x7fa3900b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3780039f0 0x7fa378003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 0x7fa378004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa378004d50 0x7fa3780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa39015c5f0 con 0x7fa378004d50 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800b9d0 con 0x7fa3780039f0 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa37800bb80 con 0x7fa3900b1dc0 2024-09-15T22:57:04.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa378004d50 0x7fa3780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38e59c640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3780039f0 0x7fa378003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 -- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 msgr2=0x7fa378004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3900b1dc0 0x7fa378004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 -- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3780039f0 msgr2=0x7fa378003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3780039f0 0x7fa378003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 -- 172.21.15.28:0/1547247731 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378003530 con 0x7fa378004d50 2024-09-15T22:57:04.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa378004d50 0x7fa3780051d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa388009fc0 tx=0x7fa38801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf45189645c617 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3880b2070 con 0x7fa378004d50 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3880a5cd0 con 0x7fa378004d50 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38d59a640 1 -- 172.21.15.28:0/1547247731 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388009c10 con 0x7fa378004d50 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 -- 172.21.15.28:0/1547247731 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa378004d50 msgr2=0x7fa3780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 --2- 172.21.15.28:0/1547247731 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa378004d50 0x7fa3780051d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa388009fc0 tx=0x7fa38801ccc0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa38ed9d640 1 -- 172.21.15.28:0/1547247731 reap_dead start 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 -- 172.21.15.28:0/1547247731 shutdown_connections 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 -- 172.21.15.28:0/1547247731 >> 172.21.15.28:0/1547247731 conn(0x7fa39006bcc0 msgr2=0x7fa39006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 -- 172.21.15.28:0/1547247731 shutdown_connections 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.155+0000 7fa394adb640 1 -- 172.21.15.28:0/1547247731 wait complete. 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 Processor -- start 2024-09-15T22:57:04.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- start start 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 0x7fa3900b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 0x7fa3900aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900cd8c0 con 0x7fa39014f210 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900cd5e0 con 0x7fa3900ae8e0 2024-09-15T22:57:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa3900b21f0 con 0x7fa39014f5f0 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57782/0 (socket says 172.21.15.28:57782) 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 -- 172.21.15.28:0/668174622 learned_addr learned my addr 172.21.15.28:0/668174622 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38dd9b640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 0x7fa3900b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 -- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 msgr2=0x7fa3900b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 0x7fa3900b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 -- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 msgr2=0x7fa3900aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 0x7fa3900aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 0x7fa3900aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 -- 172.21.15.28:0/668174622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3901f78a0 con 0x7fa39014f210 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38dd9b640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 0x7fa3900b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:04.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38ed9d640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 0x7fa3900aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa38e59c640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa380011660 tx=0x7fa380011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38000f9c0 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38000fb60 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3901f7b40 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380015460 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3900b0ff0 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3900b25b0 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.159+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa380015600 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.163+0000 7fa37effd640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 0x7fa370069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.163+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fa380086470 con 0x7fa39014f210 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.163+0000 7fa38dd9b640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 0x7fa370069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.163+0000 7fa38dd9b640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 0x7fa370069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa39014f9f0 tx=0x7fa38400c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.167+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa380019030 con 0x7fa39014f210 2024-09-15T22:57:04.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.331+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa39015bfe0 con 0x7fa39014f210 2024-09-15T22:57:04.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.331+0000 7fa37effd640 1 -- 172.21.15.28:0/668174622 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7fa380057260 con 0x7fa39014f210 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:04.335 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 msgr2=0x7fa370069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 0x7fa370069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa39014f9f0 tx=0x7fa38400c040 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 msgr2=0x7fa3901f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa380011660 tx=0x7fa380011b20 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 shutdown_connections 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa3700678c0 0x7fa370069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3900ae8e0 0x7fa3900aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa39014f5f0 0x7fa3900b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 --2- 172.21.15.28:0/668174622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39014f210 0x7fa3901f4d20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 >> 172.21.15.28:0/668174622 conn(0x7fa39006bcc0 msgr2=0x7fa39006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 shutdown_connections 2024-09-15T22:57:04.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.335+0000 7fa394adb640 1 -- 172.21.15.28:0/668174622 wait complete. 2024-09-15T22:57:04.354 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:57:04.354 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:57:04.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 Processor -- start 2024-09-15T22:57:04.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 -- start start 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbcec0cee40 0x7fbcec15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec1605b0 con 0x7fbcec15c430 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec160890 con 0x7fbcec06c3d0 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcf0921640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbcec15c810 con 0x7fbcec0cee40 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcea59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbcec15c430 0x7fbcec06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36936/0 (socket says 172.21.15.28:36936) 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcea59c640 1 -- 172.21.15.28:0/3712007508 learned_addr learned my addr 172.21.15.28:0/3712007508 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:04.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcead9d640 1 --2- 172.21.15.28:0/3712007508 >> v2:172.21.15.28:3300/0 conn(0x7fbcec0cee40 0x7fbcec15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcead9d640 1 -- 172.21.15.28:0/3712007508 >> v1:172.21.15.131:6789/0 conn(0x7fbcec06c3d0 legacy=0x7fbcec0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:04.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcead9d640 1 -- 172.21.15.28:0/3712007508 >> v1:172.21.15.28:6789/0 conn(0x7fbcec15c430 legacy=0x7fbcec06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.467+0000 7fbcead9d640 1 -- 172.21.15.28:0/3712007508 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec160b70 con 0x7fbcec0cee40 2024-09-15T22:57:04.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcead9d640 1 --2- 172.21.15.28:0/3712007508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec0cee40 0x7fbcec15feb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009d90 tx=0x7fbce401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3508f192e86810f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbce959a640 1 -- 172.21.15.28:0/3712007508 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40b2070 con 0x7fbcec0cee40 2024-09-15T22:57:04.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbce959a640 1 -- 172.21.15.28:0/3712007508 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce40a5a10 con 0x7fbcec0cee40 2024-09-15T22:57:04.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbce959a640 1 -- 172.21.15.28:0/3712007508 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40a5de0 con 0x7fbcec0cee40 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 -- 172.21.15.28:0/3712007508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec0cee40 msgr2=0x7fbcec15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 --2- 172.21.15.28:0/3712007508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec0cee40 0x7fbcec15feb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009d90 tx=0x7fbce401c930 comp rx=0 tx=0).stop 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 -- 172.21.15.28:0/3712007508 shutdown_connections 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 --2- 172.21.15.28:0/3712007508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec0cee40 0x7fbcec15feb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 -- 172.21.15.28:0/3712007508 >> 172.21.15.28:0/3712007508 conn(0x7fbcec0d1220 msgr2=0x7fbcec0d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 -- 172.21.15.28:0/3712007508 shutdown_connections 2024-09-15T22:57:04.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 -- 172.21.15.28:0/3712007508 wait complete. 2024-09-15T22:57:04.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.471+0000 7fbcf0921640 1 Processor -- start 2024-09-15T22:57:04.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- start start 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec06c3d0 0x7fbcec14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec0cee40 0x7fbcec15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec16a470 con 0x7fbcec15c430 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0cdc10 con 0x7fbcec0cee40 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec16a5f0 con 0x7fbcec06c3d0 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57810/0 (socket says 172.21.15.28:57810) 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 -- 172.21.15.28:0/1682521502 learned_addr learned my addr 172.21.15.28:0/1682521502 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcea59c640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec06c3d0 0x7fbcec14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbce9d9b640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec0cee40 0x7fbcec15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 -- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec06c3d0 msgr2=0x7fbcec14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec06c3d0 0x7fbcec14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 -- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec0cee40 msgr2=0x7fbcec15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec0cee40 0x7fbcec15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 -- 172.21.15.28:0/1682521502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec0b2de0 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcead9d640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbce40b0040 tx=0x7fbce40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40b2050 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce40be070 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec14b330 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ade40 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec150cb0 con 0x7fbcec15c430 2024-09-15T22:57:04.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec15feb0 con 0x7fbcec15c430 2024-09-15T22:57:04.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbce40c3460 con 0x7fbcec15c430 2024-09-15T22:57:04.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:04.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcea59c640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:04.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.475+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fbce4120d20 con 0x7fbcec15c430 2024-09-15T22:57:04.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.479+0000 7fbcea59c640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 0x7fbccc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000f70 tx=0x7fbcdc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:04.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.483+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbce4016520 con 0x7fbcec15c430 2024-09-15T22:57:04.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:04.639+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbcec1550d0 con 0x7fbcec15c430 2024-09-15T22:57:05.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.359+0000 7fbcdaffd640 1 -- 172.21.15.28:0/1682521502 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fbce40f1d60 con 0x7fbcec15c430 2024-09-15T22:57:05.362 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 msgr2=0x7fbccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 0x7fbccc069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000f70 tx=0x7fbcdc009040 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 msgr2=0x7fbcec15f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbce40b0040 tx=0x7fbce40196d0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 shutdown_connections 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcec15c430 0x7fbcec15f310 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbccc0678c0 0x7fbccc069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcec0cee40 0x7fbcec15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 --2- 172.21.15.28:0/1682521502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbcec06c3d0 0x7fbcec14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 >> 172.21.15.28:0/1682521502 conn(0x7fbcec0d1220 msgr2=0x7fbcec0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 shutdown_connections 2024-09-15T22:57:05.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.363+0000 7fbcf0921640 1 -- 172.21.15.28:0/1682521502 wait complete. 2024-09-15T22:57:05.391 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:57:05.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 Processor -- start 2024-09-15T22:57:05.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 -- start start 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff3d40b69b0 0x7ff3d40d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d40b74b0 con 0x7ff3d40b96d0 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d40d2a70 con 0x7ff3d40d3940 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3dc593640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff3d40d2d50 con 0x7ff3d40b69b0 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3d9b2e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff3d40b69b0 0x7ff3d40d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3da32f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff3d40b96d0 0x7ff3d40b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36946/0 (socket says 172.21.15.28:36946) 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3da32f640 1 -- 172.21.15.28:0/3515667728 learned_addr learned my addr 172.21.15.28:0/3515667728 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3d9b2e640 1 -- 172.21.15.28:0/3515667728 >> v1:172.21.15.131:6789/0 conn(0x7ff3d40d3940 legacy=0x7ff3d4161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3d9b2e640 1 -- 172.21.15.28:0/3515667728 >> v1:172.21.15.28:6789/0 conn(0x7ff3d40b96d0 legacy=0x7ff3d40b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3d932d640 1 -- 172.21.15.28:0/3515667728 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209896041 0 0) 0x7ff3d40b74b0 con 0x7ff3d40b96d0 2024-09-15T22:57:05.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.523+0000 7ff3d9b2e640 1 -- 172.21.15.28:0/3515667728 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d40d3030 con 0x7ff3d40b69b0 2024-09-15T22:57:05.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3d9b2e640 1 --2- 172.21.15.28:0/3515667728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40b69b0 0x7ff3d40d2490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40097c0 tx=0x7ff3c401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48feb574707c62a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:05.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3d932d640 1 -- 172.21.15.28:0/3515667728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b0070 con 0x7ff3d40b69b0 2024-09-15T22:57:05.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3d932d640 1 -- 172.21.15.28:0/3515667728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c40ab600 con 0x7ff3d40b69b0 2024-09-15T22:57:05.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3d932d640 1 -- 172.21.15.28:0/3515667728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40a4e60 con 0x7ff3d40b69b0 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- 172.21.15.28:0/3515667728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40b69b0 msgr2=0x7ff3d40d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3515667728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40b69b0 0x7ff3d40d2490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40097c0 tx=0x7ff3c401c3d0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- 172.21.15.28:0/3515667728 shutdown_connections 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3515667728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40b69b0 0x7ff3d40d2490 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- 172.21.15.28:0/3515667728 >> 172.21.15.28:0/3515667728 conn(0x7ff3d40d1330 msgr2=0x7ff3d40d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- 172.21.15.28:0/3515667728 shutdown_connections 2024-09-15T22:57:05.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- 172.21.15.28:0/3515667728 wait complete. 2024-09-15T22:57:05.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 Processor -- start 2024-09-15T22:57:05.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- start start 2024-09-15T22:57:05.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3d40b69b0 0x7ff3d41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:05.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3d40b96d0 0x7ff3d40cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d416c2f0 con 0x7ff3d40d3940 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d416c170 con 0x7ff3d40b96d0 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dc593640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d416c470 con 0x7ff3d40b69b0 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.527+0000 7ff3dab30640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57824/0 (socket says 172.21.15.28:57824) 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 -- 172.21.15.28:0/3958971297 learned_addr learned my addr 172.21.15.28:0/3958971297 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3d9b2e640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3d40b96d0 0x7ff3d40cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3da32f640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3d40b69b0 0x7ff3d41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 -- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3d40b69b0 msgr2=0x7ff3d41593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3d40b69b0 0x7ff3d41593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 -- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3d40b96d0 msgr2=0x7ff3d40cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3d40b96d0 0x7ff3d40cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 -- 172.21.15.28:0/3958971297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d414e9d0 con 0x7ff3d40d3940 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dab30640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b970 tx=0x7ff3cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc019070 con 0x7ff3d40d3940 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00cb40 con 0x7ff3d40d3940 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d40cbc80 con 0x7ff3d40d3940 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc014440 con 0x7ff3d40d3940 2024-09-15T22:57:05.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d40cc240 con 0x7ff3d40d3940 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d40d2490 con 0x7ff3d40d3940 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3cc01c070 con 0x7ff3d40d3940 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 0x7ff3b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7ff3cc0855e0 con 0x7ff3d40d3940 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3da32f640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 0x7ff3b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:05.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.531+0000 7ff3da32f640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 0x7ff3b8069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0000f70 tx=0x7ff3d0007b60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:05.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.535+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3cc056390 con 0x7ff3d40d3940 2024-09-15T22:57:05.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:05.699+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3d415a240 con 0x7ff3d40d3940 2024-09-15T22:57:06.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.371+0000 7ff3caffd640 1 -- 172.21.15.28:0/3958971297 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7ff3cc055c90 con 0x7ff3d40d3940 2024-09-15T22:57:06.373 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-09-15T22:57:06.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.371+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 msgr2=0x7ff3b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.371+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 0x7ff3b8069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0000f70 tx=0x7ff3d0007b60 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.371+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 msgr2=0x7ff3d414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.371+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00b970 tx=0x7ff3cc00be30 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 shutdown_connections 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3d40d3940 0x7ff3d414e490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3b80678f0 0x7ff3b8069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3d40b96d0 0x7ff3d40cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 --2- 172.21.15.28:0/3958971297 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3d40b69b0 0x7ff3d41593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 >> 172.21.15.28:0/3958971297 conn(0x7ff3d40d1330 msgr2=0x7ff3d40cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:06.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 shutdown_connections 2024-09-15T22:57:06.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.375+0000 7ff3dc593640 1 -- 172.21.15.28:0/3958971297 wait complete. 2024-09-15T22:57:06.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:57:06.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 Processor -- start 2024-09-15T22:57:06.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 -- start start 2024-09-15T22:57:06.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f129015ea00 0x7f12900b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12900d2830 0x7f12900d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12900b3ae0 con 0x7f129015e620 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f12900d2cc0 con 0x7f12900d2830 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f1294894640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f12900d2fa0 con 0x7f129015ea00 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12900d2830 0x7f12900d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12900d2830 0x7f12900d4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57828/0 (socket says 172.21.15.28:57828) 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 -- 172.21.15.28:0/3738450214 learned_addr learned my addr 172.21.15.28:0/3738450214 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128dd9b640 1 --2- 172.21.15.28:0/3738450214 >> v2:172.21.15.131:3300/0 conn(0x7f129015ea00 0x7f12900b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 -- 172.21.15.28:0/3738450214 >> v2:172.21.15.131:3300/0 conn(0x7f129015ea00 msgr2=0x7f12900b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 --2- 172.21.15.28:0/3738450214 >> v2:172.21.15.131:3300/0 conn(0x7f129015ea00 0x7f12900b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 -- 172.21.15.28:0/3738450214 >> v1:172.21.15.131:6789/0 conn(0x7f129015e620 legacy=0x7f12900b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.535+0000 7f128ed9d640 1 -- 172.21.15.28:0/3738450214 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12900d3280 con 0x7f12900d2830 2024-09-15T22:57:06.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f128ed9d640 1 --2- 172.21.15.28:0/3738450214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12900d2830 0x7f12900d4720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12900b3cd0 tx=0x7f128801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570ae78fbdb03ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:06.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f128d59a640 1 -- 172.21.15.28:0/3738450214 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12880a5860 con 0x7f12900d2830 2024-09-15T22:57:06.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f128d59a640 1 -- 172.21.15.28:0/3738450214 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12880a5a00 con 0x7f12900d2830 2024-09-15T22:57:06.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f128d59a640 1 -- 172.21.15.28:0/3738450214 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12880a5dd0 con 0x7f12900d2830 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- 172.21.15.28:0/3738450214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12900d2830 msgr2=0x7f12900d4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 --2- 172.21.15.28:0/3738450214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12900d2830 0x7f12900d4720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12900b3cd0 tx=0x7f128801c980 comp rx=0 tx=0).stop 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- 172.21.15.28:0/3738450214 shutdown_connections 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 --2- 172.21.15.28:0/3738450214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12900d2830 0x7f12900d4720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 --2- 172.21.15.28:0/3738450214 >> v2:172.21.15.131:3300/0 conn(0x7f129015ea00 0x7f12900b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- 172.21.15.28:0/3738450214 >> 172.21.15.28:0/3738450214 conn(0x7f1290067e00 msgr2=0x7f1290068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- 172.21.15.28:0/3738450214 shutdown_connections 2024-09-15T22:57:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- 172.21.15.28:0/3738450214 wait complete. 2024-09-15T22:57:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 Processor -- start 2024-09-15T22:57:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.539+0000 7f1294894640 1 -- start start 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f129015e620 0x7f1290153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f129015a9e0 0x7f1290160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f129016b6d0 con 0x7f1290159680 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f129016b550 con 0x7f129015e620 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f129016b850 con 0x7f129015a9e0 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57844/0 (socket says 172.21.15.28:57844) 2024-09-15T22:57:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 -- 172.21.15.28:0/3984168902 learned_addr learned my addr 172.21.15.28:0/3984168902 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128e59c640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f129015e620 0x7f1290153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128ed9d640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f129015a9e0 0x7f1290160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 -- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f129015a9e0 msgr2=0x7f1290160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f129015a9e0 0x7f1290160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 -- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f129015e620 msgr2=0x7f1290153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f129015e620 0x7f1290153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 -- 172.21.15.28:0/3984168902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1290159ce0 con 0x7f1290159680 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128dd9b640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f128400d860 tx=0x7f128400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128400de50 con 0x7f1290159680 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1284019070 con 0x7f1290159680 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128400bb10 con 0x7f1290159680 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1290159fc0 con 0x7f1290159680 2024-09-15T22:57:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1290151e80 con 0x7f1290159680 2024-09-15T22:57:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1290152080 con 0x7f1290159680 2024-09-15T22:57:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f128400bcb0 con 0x7f1290159680 2024-09-15T22:57:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 0x7f1270069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f1284086bc0 con 0x7f1290159680 2024-09-15T22:57:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128e59c640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 0x7f1270069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.543+0000 7f128e59c640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 0x7f1270069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f128000b810 tx=0x7f1280008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:06.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.547+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1290152080 con 0x7f1290159680 2024-09-15T22:57:06.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:06.751+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f129015b730 con 0x7f1290159680 2024-09-15T22:57:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.391+0000 7f127effd640 1 -- 172.21.15.28:0/3984168902 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f1284057840 con 0x7f1290159680 2024-09-15T22:57:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 4 and data pool 5 2024-09-15T22:57:07.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 msgr2=0x7f1270069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 0x7f1270069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f128000b810 tx=0x7f1280008040 comp rx=0 tx=0).stop 2024-09-15T22:57:07.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 msgr2=0x7f129014fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f128400d860 tx=0x7f128400dd20 comp rx=0 tx=0).stop 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 shutdown_connections 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f129015a9e0 0x7f1290160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1290159680 0x7f129014fd60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12700678c0 0x7f1270069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 --2- 172.21.15.28:0/3984168902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f129015e620 0x7f1290153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 >> 172.21.15.28:0/3984168902 conn(0x7f1290067e00 msgr2=0x7f1290156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 shutdown_connections 2024-09-15T22:57:07.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.415+0000 7f1294894640 1 -- 172.21.15.28:0/3984168902 wait complete. 2024-09-15T22:57:07.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:07.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.555+0000 7f9ce53d3640 1 Processor -- start 2024-09-15T22:57:07.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.555+0000 7f9ce53d3640 1 -- start start 2024-09-15T22:57:07.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9ce53d3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 0x7f9ce006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9ce53d3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 0x7f9ce00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9ce53d3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce006e190 con 0x7f9ce00b3610 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9ce53d3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00d2ba0 con 0x7f9ce006d870 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9ce53d3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00d2e80 con 0x7f9ce015e820 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cdf7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9ce00b3610 0x7f9ce00d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36954/0 (socket says 172.21.15.28:36954) 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3803775166 learned_addr learned my addr 172.21.15.28:0/3803775166 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cdeffd640 1 --2- 172.21.15.28:0/3803775166 >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 0x7f9ce006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 --2- 172.21.15.28:0/3803775166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 0x7f9ce00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283657135 0 0) 0x7f9ce006e190 con 0x7f9ce00b3610 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc8003530 con 0x7f9ce00b3610 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 -- 172.21.15.28:0/3803775166 >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 msgr2=0x7f9ce006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 --2- 172.21.15.28:0/3803775166 >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 0x7f9ce006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 -- 172.21.15.28:0/3803775166 >> v1:172.21.15.28:6789/0 conn(0x7f9ce00b3610 legacy=0x7f9ce00d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 877426035 0 0) 0x7f9cc8003530 con 0x7f9ce00b3610 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 -- 172.21.15.28:0/3803775166 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00d3160 con 0x7f9ce015e820 2024-09-15T22:57:07.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cdeffd640 1 --2- 172.21.15.28:0/3803775166 >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 0x7f9ce006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cde7fc640 1 --2- 172.21.15.28:0/3803775166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 0x7f9ce00cf750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40097c0 tx=0x7f9cd401ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa226faa6d1c597f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.559+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40b5070 con 0x7f9ce015e820 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd40a85f0 con 0x7f9ce015e820 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cddffb640 1 -- 172.21.15.28:0/3803775166 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8001a00 con 0x7f9ce015e820 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3803775166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 msgr2=0x7f9ce00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3803775166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 0x7f9ce00cf750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40097c0 tx=0x7f9cd401ebb0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3803775166 shutdown_connections 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3803775166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce015e820 0x7f9ce00cf750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3803775166 >> v2:172.21.15.131:3300/0 conn(0x7f9ce006d870 0x7f9ce006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3803775166 >> 172.21.15.28:0/3803775166 conn(0x7f9ce00d4910 msgr2=0x7f9ce00d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:07.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3803775166 shutdown_connections 2024-09-15T22:57:07.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3803775166 wait complete. 2024-09-15T22:57:07.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 Processor -- start 2024-09-15T22:57:07.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- start start 2024-09-15T22:57:07.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce006d870 0x7f9ce0157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 0x7f9ce015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00cfc90 con 0x7f9ce015e820 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d3720 con 0x7f9ce00b3610 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00d4350 con 0x7f9ce006d870 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57852/0 (socket says 172.21.15.28:57852) 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3856090643 learned_addr learned my addr 172.21.15.28:0/3856090643 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:07.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdeffd640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce006d870 0x7f9ce0157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cde7fc640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 0x7f9ce015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce006d870 msgr2=0x7f9ce0157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce006d870 0x7f9ce0157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 msgr2=0x7f9ce015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 0x7f9ce015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3856090643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce0158240 con 0x7f9ce015e820 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cde7fc640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 0x7f9ce015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cdf7fe640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8001f90 tx=0x7f9cd800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8012400 con 0x7f9ce015e820 2024-09-15T22:57:07.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80125a0 con 0x7f9ce015e820 2024-09-15T22:57:07.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce01f43b0 con 0x7f9ce015e820 2024-09-15T22:57:07.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8012950 con 0x7f9ce015e820 2024-09-15T22:57:07.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.563+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce01f4970 con 0x7f9ce015e820 2024-09-15T22:57:07.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce00cf750 con 0x7f9ce015e820 2024-09-15T22:57:07.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cd8012af0 con 0x7f9ce015e820 2024-09-15T22:57:07.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9cc77fe640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 0x7f9ccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd8087020 con 0x7f9ce015e820 2024-09-15T22:57:07.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9cdeffd640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 0x7f9ccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.567+0000 7f9cdeffd640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 0x7f9ccc069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009580 tx=0x7f9cd0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.571+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9cd8057c40 con 0x7f9ce015e820 2024-09-15T22:57:07.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.735+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ce00b4b50 con 0x7f9ce015e820 2024-09-15T22:57:07.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9cc77fe640 1 -- 172.21.15.28:0/3856090643 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16754 (secure 0 0 0) 0x7f9cd8057540 con 0x7f9ce015e820 2024-09-15T22:57:07.741 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:07.741 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":30,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:06.756968+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:07.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 msgr2=0x7f9ccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 0x7f9ccc069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009580 tx=0x7f9cd0008040 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 msgr2=0x7f9ce00b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8001f90 tx=0x7f9cd800a430 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 shutdown_connections 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce015e820 0x7f9ce00b5630 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9ccc0678c0 0x7f9ccc069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce00b3610 0x7f9ce015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 --2- 172.21.15.28:0/3856090643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce006d870 0x7f9ce0157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 >> 172.21.15.28:0/3856090643 conn(0x7f9ce00d4910 msgr2=0x7f9ce00d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 shutdown_connections 2024-09-15T22:57:07.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.739+0000 7f9ce53d3640 1 -- 172.21.15.28:0/3856090643 wait complete. 2024-09-15T22:57:07.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:07.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 Processor -- start 2024-09-15T22:57:07.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 -- start start 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4c806d870 0x7fa4c806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 0x7fa4c80cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c80b3610 0x7fa4c80d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c806e190 con 0x7fa4c806d870 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c80d2ba0 con 0x7fa4c815e820 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4cdd38640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c80d2e80 con 0x7fa4c80b3610 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4c806d870 0x7fa4c806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4c806d870 0x7fa4c806dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57864/0 (socket says 172.21.15.28:57864) 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 -- 172.21.15.28:0/411667405 learned_addr learned my addr 172.21.15.28:0/411667405 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c7fff640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c80b3610 0x7fa4c80d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c6ffd640 1 --2- 172.21.15.28:0/411667405 >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 0x7fa4c80cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 -- 172.21.15.28:0/411667405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c80b3610 msgr2=0x7fa4c80d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c80b3610 0x7fa4c80d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 -- 172.21.15.28:0/411667405 >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 msgr2=0x7fa4c80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/411667405 >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 0x7fa4c80cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c77fe640 1 -- 172.21.15.28:0/411667405 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c80d3160 con 0x7fa4c806d870 2024-09-15T22:57:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.887+0000 7fa4c6ffd640 1 --2- 172.21.15.28:0/411667405 >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 0x7fa4c80cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:07.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c806d870 0x7fa4c806dc50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c808d8d0 tx=0x7fa4b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff6824121e9f058 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4c67fc640 1 -- 172.21.15.28:0/411667405 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80aa430 con 0x7fa4c806d870 2024-09-15T22:57:07.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4c67fc640 1 -- 172.21.15.28:0/411667405 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b80af070 con 0x7fa4c806d870 2024-09-15T22:57:07.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4c67fc640 1 -- 172.21.15.28:0/411667405 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80aa7f0 con 0x7fa4c806d870 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 -- 172.21.15.28:0/411667405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c806d870 msgr2=0x7fa4c806dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c806d870 0x7fa4c806dc50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa4c808d8d0 tx=0x7fa4b801c4f0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 -- 172.21.15.28:0/411667405 shutdown_connections 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c80b3610 0x7fa4c80d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/411667405 >> v2:172.21.15.131:3300/0 conn(0x7fa4c815e820 0x7fa4c80cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/411667405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c806d870 0x7fa4c806dc50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 -- 172.21.15.28:0/411667405 >> 172.21.15.28:0/411667405 conn(0x7fa4c80d4910 msgr2=0x7fa4c80d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 -- 172.21.15.28:0/411667405 shutdown_connections 2024-09-15T22:57:07.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.891+0000 7fa4cdd38640 1 -- 172.21.15.28:0/411667405 wait complete. 2024-09-15T22:57:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 Processor -- start 2024-09-15T22:57:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- start start 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c806d870 0x7fa4c81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80b3610 0x7fa4c8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c806c200 con 0x7fa4c815e820 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c806c080 con 0x7fa4c80b3610 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c806c380 con 0x7fa4c806d870 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57880/0 (socket says 172.21.15.28:57880) 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 -- 172.21.15.28:0/1462452670 learned_addr learned my addr 172.21.15.28:0/1462452670 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c6ffd640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80b3610 0x7fa4c8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c806d870 0x7fa4c81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 -- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c806d870 msgr2=0x7fa4c81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c806d870 0x7fa4c81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 -- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80b3610 msgr2=0x7fa4c8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80b3610 0x7fa4c8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 -- 172.21.15.28:0/1462452670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c80ce850 con 0x7fa4c815e820 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4c7fff640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0007e90 tx=0x7fa4c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0014420 con 0x7fa4c815e820 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0019070 con 0x7fa4c815e820 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c8151de0 con 0x7fa4c815e820 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0014820 con 0x7fa4c815e820 2024-09-15T22:57:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c81523a0 con 0x7fa4c815e820 2024-09-15T22:57:07.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.895+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c80d3c40 con 0x7fa4c815e820 2024-09-15T22:57:07.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.899+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4c00149c0 con 0x7fa4c815e820 2024-09-15T22:57:07.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.899+0000 7fa4affff640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 0x7fa4b4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:07.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.899+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c0086490 con 0x7fa4c815e820 2024-09-15T22:57:07.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.899+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 0x7fa4b4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:07.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.899+0000 7fa4c77fe640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 0x7fa4b4069dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80ae000 tx=0x7fa4b80a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:07.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:07.903+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4c0057040 con 0x7fa4c815e820 2024-09-15T22:57:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.067+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4c815ec50 con 0x7fa4c815e820 2024-09-15T22:57:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4affff640 1 -- 172.21.15.28:0/1462452670 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16754 (secure 0 0 0) 0x7fa4c0056940 con 0x7fa4c815e820 2024-09-15T22:57:08.074 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:08.074 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":30,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:06.756968+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:08.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 msgr2=0x7fa4b4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 0x7fa4b4069dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80ae000 tx=0x7fa4b80a7000 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 msgr2=0x7fa4c80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0007e90 tx=0x7fa4c000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 shutdown_connections 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4c815e820 0x7fa4c80cdde0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4b4067910 0x7fa4b4069dd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80b3610 0x7fa4c8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 --2- 172.21.15.28:0/1462452670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4c806d870 0x7fa4c81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 >> 172.21.15.28:0/1462452670 conn(0x7fa4c80d4910 msgr2=0x7fa4c80cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 shutdown_connections 2024-09-15T22:57:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.071+0000 7fa4cdd38640 1 -- 172.21.15.28:0/1462452670 wait complete. 2024-09-15T22:57:08.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:57:08.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 Processor -- start 2024-09-15T22:57:08.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 -- start start 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9a70145b20 0x7f9a70072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 0x7f9a700b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9a700b2370 0x7f9a7015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9a70072ca0 con 0x7f9a70145b20 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9a700b27c0 con 0x7f9a700b2370 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a76575640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a70073a40 con 0x7f9a70072860 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9a70145b20 0x7f9a70072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9a70145b20 0x7f9a70072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57896/0 (socket says 172.21.15.28:57896) 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 -- 172.21.15.28:0/1153583516 learned_addr learned my addr 172.21.15.28:0/1153583516 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:08.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6f7fe640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 0x7f9a700b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a74b12640 1 --2- 172.21.15.28:0/1153583516 >> v2:172.21.15.131:3300/0 conn(0x7f9a700b2370 0x7f9a7015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 -- 172.21.15.28:0/1153583516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 msgr2=0x7f9a700b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 0x7f9a700b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 -- 172.21.15.28:0/1153583516 >> v2:172.21.15.131:3300/0 conn(0x7f9a700b2370 msgr2=0x7f9a7015ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1153583516 >> v2:172.21.15.131:3300/0 conn(0x7f9a700b2370 0x7f9a7015ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6ffff640 1 -- 172.21.15.28:0/1153583516 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a70072ec0 con 0x7f9a70145b20 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.223+0000 7f9a6f7fe640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 0x7f9a700b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a70072320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9a700d1190 tx=0x7f9a6001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bfa8e8ead974f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a6effd640 1 -- 172.21.15.28:0/1153583516 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600b0070 con 0x7f9a70145b20 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a6effd640 1 -- 172.21.15.28:0/1153583516 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a600ab600 con 0x7f9a70145b20 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a6effd640 1 -- 172.21.15.28:0/1153583516 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600ab9d0 con 0x7f9a70145b20 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- 172.21.15.28:0/1153583516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 msgr2=0x7f9a70072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:08.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a70072320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9a700d1190 tx=0x7f9a6001c1a0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- 172.21.15.28:0/1153583516 shutdown_connections 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- 172.21.15.28:0/1153583516 >> v2:172.21.15.131:3300/0 conn(0x7f9a700b2370 0x7f9a7015ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a70072860 0x7f9a700b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- 172.21.15.28:0/1153583516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a70072320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- 172.21.15.28:0/1153583516 >> 172.21.15.28:0/1153583516 conn(0x7f9a7006bcc0 msgr2=0x7f9a7006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- 172.21.15.28:0/1153583516 shutdown_connections 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- 172.21.15.28:0/1153583516 wait complete. 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 Processor -- start 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- start start 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a70072860 0x7f9a70159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a700b2370 0x7f9a70144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70145f00 con 0x7f9a70145b20 2024-09-15T22:57:08.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a700ccda0 con 0x7f9a70072860 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.227+0000 7f9a76575640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a70146080 con 0x7f9a700b2370 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57908/0 (socket says 172.21.15.28:57908) 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 -- 172.21.15.28:0/1519526704 learned_addr learned my addr 172.21.15.28:0/1519526704 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a70072860 0x7f9a70159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6f7fe640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a700b2370 0x7f9a70144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 -- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a700b2370 msgr2=0x7f9a70144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a700b2370 0x7f9a70144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 -- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a70072860 msgr2=0x7f9a70159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a70072860 0x7f9a70159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 -- 172.21.15.28:0/1519526704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a700724e0 con 0x7f9a70145b20 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a74b12640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007e40 tx=0x7f9a6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:08.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68014620 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a68019070 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a701f7c80 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68014a20 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a70145300 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a70069220 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a68014bc0 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 0x7f9a5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f9a68086470 con 0x7f9a70145b20 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 0x7f9a5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.231+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 0x7f9a5c069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a600ad000 tx=0x7f9a60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:08.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.235+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a68057040 con 0x7f9a70145b20 2024-09-15T22:57:08.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:08.439+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a7015ff90 con 0x7f9a70145b20 2024-09-15T22:57:09.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.411+0000 7f9a6cff9640 1 -- 172.21.15.28:0/1519526704 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f9a68056940 con 0x7f9a70145b20 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 msgr2=0x7f9a5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 0x7f9a5c069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a600ad000 tx=0x7f9a60008040 comp rx=0 tx=0).stop 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 msgr2=0x7f9a700ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007e40 tx=0x7f9a6800e4b0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 shutdown_connections 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a70145b20 0x7f9a700ae8b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a700b2370 0x7f9a70144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9a5c0678f0 0x7f9a5c069db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 --2- 172.21.15.28:0/1519526704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a70072860 0x7f9a70159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 >> 172.21.15.28:0/1519526704 conn(0x7f9a7006bcc0 msgr2=0x7f9a7015e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 shutdown_connections 2024-09-15T22:57:09.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.415+0000 7f9a76575640 1 -- 172.21.15.28:0/1519526704 wait complete. 2024-09-15T22:57:09.436 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:57:09.436 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:57:09.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.567+0000 7f47bd84b640 1 Processor -- start 2024-09-15T22:57:09.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.567+0000 7f47bd84b640 1 -- start start 2024-09-15T22:57:09.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47bd84b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47bd84b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47b80cd380 0x7f47b8073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47bd84b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b80cd810 con 0x7f47b80b1e30 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47bd84b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f47b80cdaf0 con 0x7f47b80cd380 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47bd84b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80cddd0 con 0x7f47b815b150 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:60758/0 (socket says 172.21.15.28:60758) 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b67fc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47b80cd380 0x7f47b8073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 -- 172.21.15.28:0/2245152863 learned_addr learned my addr 172.21.15.28:0/2245152863 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 -- 172.21.15.28:0/2245152863 >> v2:172.21.15.131:3300/0 conn(0x7f47b80cd380 msgr2=0x7f47b8073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 --2- 172.21.15.28:0/2245152863 >> v2:172.21.15.131:3300/0 conn(0x7f47b80cd380 0x7f47b8073cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 -- 172.21.15.28:0/2245152863 >> v1:172.21.15.131:6789/0 conn(0x7f47b80b1e30 legacy=0x7f47b8071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.571+0000 7f47b6ffd640 1 -- 172.21.15.28:0/2245152863 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80ce0b0 con 0x7f47b815b150 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b6ffd640 1 --2- 172.21.15.28:0/2245152863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d98f734f4eacb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b5ffb640 1 -- 172.21.15.28:0/2245152863 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80b5070 con 0x7f47b815b150 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b5ffb640 1 -- 172.21.15.28:0/2245152863 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a80a8a50 con 0x7f47b815b150 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b5ffb640 1 -- 172.21.15.28:0/2245152863 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80a8e20 con 0x7f47b815b150 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- 172.21.15.28:0/2245152863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 msgr2=0x7f47b80ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- 172.21.15.28:0/2245152863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a801ed50 comp rx=0 tx=0).stop 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- 172.21.15.28:0/2245152863 shutdown_connections 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- 172.21.15.28:0/2245152863 >> v2:172.21.15.131:3300/0 conn(0x7f47b80cd380 0x7f47b8073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- 172.21.15.28:0/2245152863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b815b150 0x7f47b80ce8b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- 172.21.15.28:0/2245152863 >> 172.21.15.28:0/2245152863 conn(0x7f47b806bcc0 msgr2=0x7f47b806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- 172.21.15.28:0/2245152863 shutdown_connections 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- 172.21.15.28:0/2245152863 wait complete. 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 Processor -- start 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- start start 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b815b150 0x7f47b8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b81545b0 0x7f47b80d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47b815b530 con 0x7f47b80b1e30 2024-09-15T22:57:09.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80cedf0 con 0x7f47b815b150 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47bd84b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80741f0 con 0x7f47b81545b0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57912/0 (socket says 172.21.15.28:57912) 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.575+0000 7f47b6ffd640 1 -- 172.21.15.28:0/130695995 learned_addr learned my addr 172.21.15.28:0/130695995 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b77fe640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b81545b0 0x7f47b80d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b67fc640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b815b150 0x7f47b8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 -- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b81545b0 msgr2=0x7f47b80d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b81545b0 0x7f47b80d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 -- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b815b150 msgr2=0x7f47b8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b815b150 0x7f47b8154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 -- 172.21.15.28:0/130695995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81521c0 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b6ffd640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f47a80b3040 tx=0x7f47a801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80b5070 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a80b0de0 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81524a0 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80bb670 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b8152a60 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b8069220 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47a80c2060 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 0x7f47a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f47a8123400 con 0x7f47b80b1e30 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b67fc640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 0x7f47a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.579+0000 7f47b67fc640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 0x7f47a4069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47b815e860 tx=0x7f47ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.583+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47a80188b0 con 0x7f47b80b1e30 2024-09-15T22:57:09.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:09.787+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f47b8073cb0 con 0x7f47b80b1e30 2024-09-15T22:57:10.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.423+0000 7f479ffff640 1 -- 172.21.15.28:0/130695995 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f47a80f3f20 con 0x7f47b80b1e30 2024-09-15T22:57:10.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 msgr2=0x7f47a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 0x7f47a4069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47b815e860 tx=0x7f47ac008040 comp rx=0 tx=0).stop 2024-09-15T22:57:10.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 msgr2=0x7f47b81481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f47a80b3040 tx=0x7f47a801baf0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 shutdown_connections 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b81545b0 0x7f47b80d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f47a40678c0 0x7f47a4069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b815b150 0x7f47b8154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 --2- 172.21.15.28:0/130695995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b80b1e30 0x7f47b81481d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 >> 172.21.15.28:0/130695995 conn(0x7f47b806bcc0 msgr2=0x7f47b80ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 shutdown_connections 2024-09-15T22:57:10.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.427+0000 7f47bd84b640 1 -- 172.21.15.28:0/130695995 wait complete. 2024-09-15T22:57:10.449 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:57:10.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:10.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.587+0000 7faa94228640 1 Processor -- start 2024-09-15T22:57:10.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.587+0000 7faa94228640 1 -- start start 2024-09-15T22:57:10.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa94228640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa8c0b4710 0x7faa8c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa94228640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa94228640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c0b4bd0 con 0x7faa8c0cde30 2024-09-15T22:57:10.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa94228640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7faa8c15f260 con 0x7faa8c0b4710 2024-09-15T22:57:10.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa94228640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c0b4080 con 0x7faa8c0ce210 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa8c0b4710 0x7faa8c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa8c0b4710 0x7faa8c0b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57920/0 (socket says 172.21.15.28:57920) 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 -- 172.21.15.28:0/1700383162 learned_addr learned my addr 172.21.15.28:0/1700383162 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa927c5640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 -- 172.21.15.28:0/1700383162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 msgr2=0x7faa8c15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 -- 172.21.15.28:0/1700383162 >> v1:172.21.15.131:6789/0 conn(0x7faa8c0cde30 legacy=0x7faa8c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 -- 172.21.15.28:0/1700383162 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c0b4eb0 con 0x7faa8c0b4710 2024-09-15T22:57:10.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa917c3640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c0b3b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa80009e80 tx=0x7faa8001da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c665a7005ddaa1fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa90fc2640 1 -- 172.21.15.28:0/1700383162 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa800a67d0 con 0x7faa8c0b4710 2024-09-15T22:57:10.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa90fc2640 1 -- 172.21.15.28:0/1700383162 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa800a6970 con 0x7faa8c0b4710 2024-09-15T22:57:10.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.591+0000 7faa90fc2640 1 -- 172.21.15.28:0/1700383162 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa800a6d40 con 0x7faa8c0b4710 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/1700383162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 msgr2=0x7faa8c0b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c0b3b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa80009e80 tx=0x7faa8001da60 comp rx=0 tx=0).stop 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/1700383162 shutdown_connections 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- 172.21.15.28:0/1700383162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c0b3b40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/1700383162 >> 172.21.15.28:0/1700383162 conn(0x7faa8c06bcc0 msgr2=0x7faa8c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/1700383162 shutdown_connections 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/1700383162 wait complete. 2024-09-15T22:57:10.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 Processor -- start 2024-09-15T22:57:10.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- start start 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 0x7faa8c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0d0050 con 0x7faa8c0b4710 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0cfed0 con 0x7faa8c0cde30 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c0d01d0 con 0x7faa8c0ce210 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57934/0 (socket says 172.21.15.28:57934) 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 -- 172.21.15.28:0/41732921 learned_addr learned my addr 172.21.15.28:0/41732921 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa927c5640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa917c3640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 0x7faa8c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 -- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 msgr2=0x7faa8c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 -- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 msgr2=0x7faa8c15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 0x7faa8c15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 -- 172.21.15.28:0/41732921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c14dc60 con 0x7faa8c0b4710 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa917c3640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 0x7faa8c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa91fc4640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00c450 tx=0x7faa7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c016020 con 0x7faa8c0b4710 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c0052d0 con 0x7faa8c0b4710 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c007260 con 0x7faa8c0b4710 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c151cb0 con 0x7faa8c0b4710 2024-09-15T22:57:10.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.595+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c152270 con 0x7faa8c0b4710 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c0b3b40 con 0x7faa8c0b4710 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa7c007400 con 0x7faa8c0b4710 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa8a7fc640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 0x7faa78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7faa7c0855c0 con 0x7faa8c0b4710 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa917c3640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 0x7faa78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.599+0000 7faa917c3640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 0x7faa78069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa800af000 tx=0x7faa8000d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.603+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa7c020020 con 0x7faa8c0b4710 2024-09-15T22:57:10.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.795+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa8c06c220 con 0x7faa8c0b4710 2024-09-15T22:57:10.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa8a7fc640 1 -- 172.21.15.28:0/41732921 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7faa7c005480 con 0x7faa8c0b4710 2024-09-15T22:57:10.798 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:10.798 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"btime":"2024-09-15T22:57:10:415033+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:09.788691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 msgr2=0x7faa78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 0x7faa78069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa800af000 tx=0x7faa8000d040 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 msgr2=0x7faa8c14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00c450 tx=0x7faa7c00c910 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 shutdown_connections 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8c0ce210 0x7faa8c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa780678c0 0x7faa78069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0cde30 0x7faa8c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 --2- 172.21.15.28:0/41732921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c0b4710 0x7faa8c14d720 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 >> 172.21.15.28:0/41732921 conn(0x7faa8c06bcc0 msgr2=0x7faa8c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 shutdown_connections 2024-09-15T22:57:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.799+0000 7faa94228640 1 -- 172.21.15.28:0/41732921 wait complete. 2024-09-15T22:57:10.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:10.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 Processor -- start 2024-09-15T22:57:10.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 -- start start 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b006c3d0 0x7fd0b00af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b015e9b0 con 0x7fd0b00cffd0 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b00aee30 con 0x7fd0b006c3d0 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b716e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b00700c0 con 0x7fd0b015e5d0 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b006c3d0 0x7fd0b00af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b006c3d0 0x7fd0b00af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57950/0 (socket says 172.21.15.28:57950) 2024-09-15T22:57:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 -- 172.21.15.28:0/1997496538 learned_addr learned my addr 172.21.15.28:0/1997496538 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:10.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b4f0a640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 -- 172.21.15.28:0/1997496538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 msgr2=0x7fd0b00cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 -- 172.21.15.28:0/1997496538 >> v1:172.21.15.131:6789/0 conn(0x7fd0b00cffd0 legacy=0x7fd0b006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.938+0000 7fd0b570b640 1 -- 172.21.15.28:0/1997496538 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b00703a0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b570b640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b00af5f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009e50 tx=0x7fd0a801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc69874776be8637 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0af7fe640 1 -- 172.21.15.28:0/1997496538 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80a5750 con 0x7fd0b006c3d0 2024-09-15T22:57:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0af7fe640 1 -- 172.21.15.28:0/1997496538 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a80a58f0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0af7fe640 1 -- 172.21.15.28:0/1997496538 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80a5cc0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- 172.21.15.28:0/1997496538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 msgr2=0x7fd0b00af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b00af5f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009e50 tx=0x7fd0a801c9a0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- 172.21.15.28:0/1997496538 shutdown_connections 2024-09-15T22:57:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b00af5f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1997496538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- 172.21.15.28:0/1997496538 >> 172.21.15.28:0/1997496538 conn(0x7fd0b00b2e10 msgr2=0x7fd0b00b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- 172.21.15.28:0/1997496538 shutdown_connections 2024-09-15T22:57:10.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- 172.21.15.28:0/1997496538 wait complete. 2024-09-15T22:57:10.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 Processor -- start 2024-09-15T22:57:10.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.942+0000 7fd0b716e640 1 -- start start 2024-09-15T22:57:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0b00cffd0 0x7fd0b00c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b00b04c0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b00b0340 con 0x7fd0b00cffd0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b00b0640 con 0x7fd0b015e5d0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57960/0 (socket says 172.21.15.28:57960) 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 -- 172.21.15.28:0/1433966732 learned_addr learned my addr 172.21.15.28:0/1433966732 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b570b640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0affff640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0b00cffd0 0x7fd0b00c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 -- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 msgr2=0x7fd0b00b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 -- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0b00cffd0 msgr2=0x7fd0b00c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0b00cffd0 0x7fd0b00c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 -- 172.21.15.28:0/1433966732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b0159450 con 0x7fd0b006c3d0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b4f0a640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000d620 tx=0x7fd0a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000b620 con 0x7fd0b006c3d0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a0019070 con 0x7fd0b006c3d0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b00c7c50 con 0x7fd0b006c3d0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000b9e0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b00c8210 con 0x7fd0b006c3d0 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b00af5f0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0a000bb80 con 0x7fd0b006c3d0 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 0x7fd090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0affff640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 0x7fd090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.946+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd0a0085fe0 con 0x7fd0b006c3d0 2024-09-15T22:57:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.950+0000 7fd0affff640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 0x7fd090069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006c350 tx=0x7fd098009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:10.954+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0a0056bb0 con 0x7fd0b006c3d0 2024-09-15T22:57:11.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.118+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0b0068530 con 0x7fd0b006c3d0 2024-09-15T22:57:11.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0ad7fa640 1 -- 172.21.15.28:0/1433966732 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16741 (secure 0 0 0) 0x7fd0a00564b0 con 0x7fd0b006c3d0 2024-09-15T22:57:11.121 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:11.121 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":31,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:08.393621+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 msgr2=0x7fd090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 0x7fd090069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd0b006c350 tx=0x7fd098009040 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 msgr2=0x7fd0b0158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000d620 tx=0x7fd0a000dae0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 shutdown_connections 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0b015e5d0 0x7fd0b00b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd0900678c0 0x7fd090069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0b00cffd0 0x7fd0b00c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 --2- 172.21.15.28:0/1433966732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b006c3d0 0x7fd0b0158f10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 >> 172.21.15.28:0/1433966732 conn(0x7fd0b00b2e10 msgr2=0x7fd0b00b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:11.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 shutdown_connections 2024-09-15T22:57:11.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.122+0000 7fd0b716e640 1 -- 172.21.15.28:0/1433966732 wait complete. 2024-09-15T22:57:11.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:57:11.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:11.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.258+0000 7f61a2ab5640 1 Processor -- start 2024-09-15T22:57:11.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a2ab5640 1 -- start start 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a2ab5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f619c0d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a2ab5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c0d2ba0 con 0x7f619c15e820 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a2ab5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c0d2e80 con 0x7f619c06d870 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a2ab5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f619c0d3160 con 0x7f619c0b3610 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f619c15e820 0x7f619c0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36956/0 (socket says 172.21.15.28:36956) 2024-09-15T22:57:11.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619bfff640 1 -- 172.21.15.28:0/3883573202 learned_addr learned my addr 172.21.15.28:0/3883573202 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a1052640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f619c0d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404561490 0 0) 0x7f619c0d2ba0 con 0x7f619c15e820 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6188003530 con 0x7f619c15e820 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 221972797 0 0) 0x7f6188003530 con 0x7f619c15e820 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 msgr2=0x7f619c0d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f619c0d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 >> v1:172.21.15.131:6789/0 conn(0x7f619c06d870 legacy=0x7f619c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c0d3440 con 0x7f619c15e820 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f6184001a00 con 0x7f619c15e820 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 >> v1:172.21.15.28:6789/0 conn(0x7f619c15e820 legacy=0x7f619c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61880039f0 0x7f6188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f6188004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6188004d50 0x7f61880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0d3160 con 0x7f61880039f0 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f618800b9d0 con 0x7f6188004d50 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f618800bbd0 con 0x7f619c0b3610 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61880039f0 0x7f6188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f619bfff640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f6188004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a1052640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6188004d50 0x7f61880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 -- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 msgr2=0x7f6188004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c0b3610 0x7f6188004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 -- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6188004d50 msgr2=0x7f61880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6188004d50 0x7f61880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.262+0000 7f61a0851640 1 -- 172.21.15.28:0/3883573202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6188003530 con 0x7f61880039f0 2024-09-15T22:57:11.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a0851640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61880039f0 0x7f6188003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6194001910 tx=0x7f619401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c871d4203210da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940b5070 con 0x7f61880039f0 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61940a8870 con 0x7f61880039f0 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f619b7fe640 1 -- 172.21.15.28:0/3883573202 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194001510 con 0x7f61880039f0 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- 172.21.15.28:0/3883573202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61880039f0 msgr2=0x7f6188003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/3883573202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61880039f0 0x7f6188003dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6194001910 tx=0x7f619401ec30 comp rx=0 tx=0).stop 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a1052640 1 -- 172.21.15.28:0/3883573202 reap_dead start 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- 172.21.15.28:0/3883573202 shutdown_connections 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- 172.21.15.28:0/3883573202 >> 172.21.15.28:0/3883573202 conn(0x7f619c0d4910 msgr2=0x7f619c0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- 172.21.15.28:0/3883573202 shutdown_connections 2024-09-15T22:57:11.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- 172.21.15.28:0/3883573202 wait complete. 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 Processor -- start 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- start start 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61880039f0 0x7f619c15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c1f3ec0 0x7f619c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0d3dc0 con 0x7f619c0cc720 2024-09-15T22:57:11.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0d3c40 con 0x7f61880039f0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.266+0000 7f61a2ab5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f619c0d3f40 con 0x7f619c1f3ec0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57982/0 (socket says 172.21.15.28:57982) 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 -- 172.21.15.28:0/2740123867 learned_addr learned my addr 172.21.15.28:0/2740123867 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f619bfff640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c1f3ec0 0x7f619c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a0851640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61880039f0 0x7f619c15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 -- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c1f3ec0 msgr2=0x7f619c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c1f3ec0 0x7f619c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 -- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61880039f0 msgr2=0x7f619c15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61880039f0 0x7f619c15be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 -- 172.21.15.28:0/2740123867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c160ab0 con 0x7f619c0cc720 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a1052640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f619c08d6c0 tx=0x7f618c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c019020 con 0x7f619c0cc720 2024-09-15T22:57:11.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618c003620 con 0x7f619c0cc720 2024-09-15T22:57:11.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619c0c8360 con 0x7f619c0cc720 2024-09-15T22:57:11.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c003a10 con 0x7f619c0cc720 2024-09-15T22:57:11.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619c0c8920 con 0x7f619c0cc720 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619c0d4310 con 0x7f619c0cc720 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f618c01c020 con 0x7f619c0cc720 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 0x7f617c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f618c085f40 con 0x7f619c0cc720 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a0851640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 0x7f617c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.270+0000 7f61a0851640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 0x7f617c069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61940b2000 tx=0x7f6194001330 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.274+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f618c023030 con 0x7f619c0cc720 2024-09-15T22:57:11.346 INFO:tasks.ceph.mds.c.smithi028.stderr:2024-09-15T22:57:11.346+0000 7f304bded640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:57:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.430+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f619c0cfb40 con 0x7f617c0678c0 2024-09-15T22:57:11.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.446+0000 7f61997fa640 1 -- 172.21.15.28:0/2740123867 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237200 (secure 0 0 0) 0x7f619c0cfb40 con 0x7f617c0678c0 2024-09-15T22:57:11.450 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 msgr2=0x7f617c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 0x7f617c069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61940b2000 tx=0x7f6194001330 comp rx=0 tx=0).stop 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 msgr2=0x7f619c0ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f619c08d6c0 tx=0x7f618c011920 comp rx=0 tx=0).stop 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 shutdown_connections 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f619c0cc720 0x7f619c0ca700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f619c1f3ec0 0x7f619c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f617c0678c0 0x7f617c069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 --2- 172.21.15.28:0/2740123867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61880039f0 0x7f619c15be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 >> 172.21.15.28:0/2740123867 conn(0x7f619c0d4910 msgr2=0x7f619c0b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 shutdown_connections 2024-09-15T22:57:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.450+0000 7f61a2ab5640 1 -- 172.21.15.28:0/2740123867 wait complete. 2024-09-15T22:57:11.466 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-15T22:57:09.880890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236416,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738304,"statfs":{"total":773094113280,"available":772852023296,"internally_reserved":0,"allocated":3579904,"data_stored":2052472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.515116"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:57:01.375997+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:01.375997+0000","last_peered":"2024-09-15T22:57:01.375997+0000","last_clean":"2024-09-15T22:57:01.375997+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:01.375997+0000","last_undegraded":"2024-09-15T22:57:01.375997+0000","last_fullsized":"2024-09-15T22:57:01.375997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31480,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31480,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:11.471 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:11.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 Processor -- start 2024-09-15T22:57:11.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 -- start start 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9880b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880d1ff0 con 0x7fc9880d2d90 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880d22b0 con 0x7fc98815e570 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc9905e1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9880d2590 con 0x7fc98815e190 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98eb7e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc9880d2d90 0x7fc98806cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36958/0 (socket says 172.21.15.28:36958) 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98eb7e640 1 -- 172.21.15.28:0/1197979002 learned_addr learned my addr 172.21.15.28:0/1197979002 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9880b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773272167 0 0) 0x7fc9880d1ff0 con 0x7fc9880d2d90 2024-09-15T22:57:11.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc974003530 con 0x7fc9880d2d90 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738065400 0 0) 0x7fc974003530 con 0x7fc9880d2d90 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 msgr2=0x7fc9880b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9880b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 >> v1:172.21.15.131:6789/0 conn(0x7fc98815e570 legacy=0x7fc988162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880d2870 con 0x7fc9880d2d90 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fc984001a20 con 0x7fc9880d2d90 2024-09-15T22:57:11.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 >> v1:172.21.15.28:6789/0 conn(0x7fc9880d2d90 legacy=0x7fc98806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9740039f0 0x7fc974003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc974004810 0x7fc974004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880d2590 con 0x7fc9740039f0 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9740039f0 0x7fc974003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc97400ba80 con 0x7fc974004810 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc97400bc80 con 0x7fc98815e190 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98eb7e640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98db7c640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc974004810 0x7fc974004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 -- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 msgr2=0x7fc9740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 -- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc974004810 msgr2=0x7fc974004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc974004810 0x7fc974004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98e37d640 1 -- 172.21.15.28:0/1197979002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc974003530 con 0x7fc9740039f0 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98eb7e640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc98815e190 0x7fc9740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:11.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.634+0000 7fc98db7c640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc974004810 0x7fc974004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:11.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc98e37d640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9740039f0 0x7fc974003e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc980009ab0 tx=0x7fc98001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd62d0f4f1e37d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b2070 con 0x7fc9740039f0 2024-09-15T22:57:11.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800a5590 con 0x7fc9740039f0 2024-09-15T22:57:11.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc98d37b640 1 -- 172.21.15.28:0/1197979002 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800096b0 con 0x7fc9740039f0 2024-09-15T22:57:11.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- 172.21.15.28:0/1197979002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9740039f0 msgr2=0x7fc974003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 --2- 172.21.15.28:0/1197979002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9740039f0 0x7fc974003e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc980009ab0 tx=0x7fc98001ca30 comp rx=0 tx=0).stop 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc98eb7e640 1 -- 172.21.15.28:0/1197979002 reap_dead start 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- 172.21.15.28:0/1197979002 shutdown_connections 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- 172.21.15.28:0/1197979002 >> 172.21.15.28:0/1197979002 conn(0x7fc988067bd0 msgr2=0x7fc988067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- 172.21.15.28:0/1197979002 shutdown_connections 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- 172.21.15.28:0/1197979002 wait complete. 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 Processor -- start 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- start start 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 0x7fc9881f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9881600f0 0x7fc9881ea770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880b4670 con 0x7fc9881f7c60 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880b44f0 con 0x7fc9740039f0 2024-09-15T22:57:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.638+0000 7fc9905e1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9880b47f0 con 0x7fc9881600f0 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58004/0 (socket says 172.21.15.28:58004) 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 -- 172.21.15.28:0/3269067949 learned_addr learned my addr 172.21.15.28:0/3269067949 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98e37d640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 0x7fc9881f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98eb7e640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9881600f0 0x7fc9881ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 -- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9881600f0 msgr2=0x7fc9881ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9881600f0 0x7fc9881ea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 -- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 msgr2=0x7fc9881f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 0x7fc9881f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 -- 172.21.15.28:0/3269067949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98815edf0 con 0x7fc9881f7c60 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98e37d640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 0x7fc9881f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98db7c640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d7a0 tx=0x7fc97800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978005270 con 0x7fc9881f7c60 2024-09-15T22:57:11.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978017070 con 0x7fc9881f7c60 2024-09-15T22:57:11.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98815f0d0 con 0x7fc9881f7c60 2024-09-15T22:57:11.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97800b650 con 0x7fc9881f7c60 2024-09-15T22:57:11.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98815f690 con 0x7fc9881f7c60 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98806cfe0 con 0x7fc9881f7c60 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc97800b810 con 0x7fc9881f7c60 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 0x7fc96c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc978085ad0 con 0x7fc9881f7c60 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98e37d640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 0x7fc96c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:11.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.642+0000 7fc98e37d640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 0x7fc96c069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9800af000 tx=0x7fc9800046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:11.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.646+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc978056610 con 0x7fc9881f7c60 2024-09-15T22:57:11.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.810+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc98806d4d0 con 0x7fc96c0678c0 2024-09-15T22:57:11.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.814+0000 7fc97effd640 1 -- 172.21.15.28:0/3269067949 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237200 (secure 0 0 0) 0x7fc98806d4d0 con 0x7fc96c0678c0 2024-09-15T22:57:11.818 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:11.819 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:11.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 msgr2=0x7fc96c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 0x7fc96c069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9800af000 tx=0x7fc9800046d0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 msgr2=0x7fc98815fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d7a0 tx=0x7fc97800dc60 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 shutdown_connections 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9881600f0 0x7fc9881ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9881f7c60 0x7fc98815fbb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc96c0678c0 0x7fc96c069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 --2- 172.21.15.28:0/3269067949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9740039f0 0x7fc9881f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 >> 172.21.15.28:0/3269067949 conn(0x7fc988067bd0 msgr2=0x7fc9880b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 shutdown_connections 2024-09-15T22:57:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:11.818+0000 7fc9905e1640 1 -- 172.21.15.28:0/3269067949 wait complete. 2024-09-15T22:57:11.837 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-15T22:57:09.880890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236416,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738304,"statfs":{"total":773094113280,"available":772852023296,"internally_reserved":0,"allocated":3579904,"data_stored":2052472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.515116"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:06.364764+0000","last_change":"2024-09-15T22:57:06.364764+0000","last_active":"2024-09-15T22:57:06.364764+0000","last_peered":"2024-09-15T22:57:06.364764+0000","last_clean":"2024-09-15T22:57:06.364764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:06.364764+0000","last_undegraded":"2024-09-15T22:57:06.364764+0000","last_fullsized":"2024-09-15T22:57:06.364764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T22:57:05.355857+0000","last_change":"2024-09-15T22:57:05.355857+0000","last_active":"2024-09-15T22:57:05.355857+0000","last_peered":"2024-09-15T22:57:05.355857+0000","last_clean":"2024-09-15T22:57:05.355857+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:57:05.355857+0000","last_undegraded":"2024-09-15T22:57:05.355857+0000","last_fullsized":"2024-09-15T22:57:05.355857+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T22:57:01.375997+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:01.375997+0000","last_peered":"2024-09-15T22:57:01.375997+0000","last_clean":"2024-09-15T22:57:01.375997+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:01.375997+0000","last_undegraded":"2024-09-15T22:57:01.375997+0000","last_fullsized":"2024-09-15T22:57:01.375997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31480,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31480,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:11.841 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:12.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 Processor -- start 2024-09-15T22:57:12.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 -- start start 2024-09-15T22:57:12.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53c00b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c0162cb0 con 0x7f53c00cfd00 2024-09-15T22:57:12.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c00b4dc0 con 0x7f53c015e4d0 2024-09-15T22:57:12.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53c4ab5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53c00b4b70 con 0x7f53c015e8b0 2024-09-15T22:57:12.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bdd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f53c00cfd00 0x7f53c00b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36970/0 (socket says 172.21.15.28:36970) 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bdd9b640 1 -- 172.21.15.28:0/2063935594 learned_addr learned my addr 172.21.15.28:0/2063935594 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bed9d640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53c00b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665668468 0 0) 0x7f53c0162cb0 con 0x7f53c00cfd00 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53a8003530 con 0x7f53c00cfd00 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553917187 0 0) 0x7f53a8003530 con 0x7f53c00cfd00 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 msgr2=0x7f53c00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53c00b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 >> v1:172.21.15.131:6789/0 conn(0x7f53c015e4d0 legacy=0x7f53c00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00b50a0 con 0x7f53c00cfd00 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f53b4001680 con 0x7f53c00cfd00 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 >> v1:172.21.15.28:6789/0 conn(0x7f53c00cfd00 legacy=0x7f53c00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53a80039f0 0x7f53a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a8004d50 0x7f53a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00b4b70 con 0x7f53a80039f0 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53a800bab0 con 0x7f53a8004d50 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53a800bcb0 con 0x7f53c015e8b0 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53a80039f0 0x7f53a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bed9d640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a8004d50 0x7f53a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53bdd9b640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 -- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 msgr2=0x7f53a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c015e8b0 0x7f53a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 -- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a8004d50 msgr2=0x7f53a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a8004d50 0x7f53a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.014+0000 7f53be59c640 1 -- 172.21.15.28:0/2063935594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a8003530 con 0x7f53a80039f0 2024-09-15T22:57:12.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53be59c640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53a80039f0 0x7f53a8003e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53b0001750 tx=0x7f53b001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654df07d2a992b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00013a0 con 0x7f53a80039f0 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00052f0 con 0x7f53a80039f0 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53bd59a640 1 -- 172.21.15.28:0/2063935594 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0003840 con 0x7f53a80039f0 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- 172.21.15.28:0/2063935594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53a80039f0 msgr2=0x7f53a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/2063935594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53a80039f0 0x7f53a8003e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53b0001750 tx=0x7f53b001c3e0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53bed9d640 1 -- 172.21.15.28:0/2063935594 reap_dead start 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- 172.21.15.28:0/2063935594 shutdown_connections 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- 172.21.15.28:0/2063935594 >> 172.21.15.28:0/2063935594 conn(0x7f53c00b15d0 msgr2=0x7f53c00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- 172.21.15.28:0/2063935594 shutdown_connections 2024-09-15T22:57:12.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- 172.21.15.28:0/2063935594 wait complete. 2024-09-15T22:57:12.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 Processor -- start 2024-09-15T22:57:12.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.018+0000 7f53c4ab5640 1 -- start start 2024-09-15T22:57:12.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a80039f0 0x7f53c0160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c0153140 0x7f53c0159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53c016a210 con 0x7f53c014e470 2024-09-15T22:57:12.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53c016a090 con 0x7f53a80039f0 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53c016a390 con 0x7f53c0153140 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58030/0 (socket says 172.21.15.28:58030) 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 -- 172.21.15.28:0/4113918914 learned_addr learned my addr 172.21.15.28:0/4113918914 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53be59c640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a80039f0 0x7f53c0160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bed9d640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c0153140 0x7f53c0159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 -- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c0153140 msgr2=0x7f53c0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c0153140 0x7f53c0159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 -- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a80039f0 msgr2=0x7f53c0160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a80039f0 0x7f53c0160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 -- 172.21.15.28:0/4113918914 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c0153ab0 con 0x7f53c014e470 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53bdd9b640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e780 tx=0x7f53b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b400ee90 con 0x7f53c014e470 2024-09-15T22:57:12.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4018070 con 0x7f53c014e470 2024-09-15T22:57:12.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c0153d90 con 0x7f53c014e470 2024-09-15T22:57:12.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b400cb10 con 0x7f53c014e470 2024-09-15T22:57:12.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c0154350 con 0x7f53c014e470 2024-09-15T22:57:12.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c00b58a0 con 0x7f53c014e470 2024-09-15T22:57:12.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53b400ccb0 con 0x7f53c014e470 2024-09-15T22:57:12.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 0x7f53a0069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f53b4085bc0 con 0x7f53c014e470 2024-09-15T22:57:12.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53be59c640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 0x7f53a0069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.022+0000 7f53be59c640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 0x7f53a0069f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53a80057f0 tx=0x7f53b00011a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.026+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53b4056700 con 0x7f53c014e470 2024-09-15T22:57:12.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.186+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53c01561d0 con 0x7f53a0067a60 2024-09-15T22:57:12.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.202+0000 7f53aeffd640 1 -- 172.21.15.28:0/4113918914 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f53c01561d0 con 0x7f53a0067a60 2024-09-15T22:57:12.207 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:12.210 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:12.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 msgr2=0x7f53a0069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 0x7f53a0069f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53a80057f0 tx=0x7f53b00011a0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 msgr2=0x7f53c0154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e780 tx=0x7f53b400ec40 comp rx=0 tx=0).stop 2024-09-15T22:57:12.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 shutdown_connections 2024-09-15T22:57:12.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53c0153140 0x7f53c0159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c014e470 0x7f53c0154b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53a0067a60 0x7f53a0069f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 --2- 172.21.15.28:0/4113918914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a80039f0 0x7f53c0160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 >> 172.21.15.28:0/4113918914 conn(0x7f53c00b15d0 msgr2=0x7f53c014ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 shutdown_connections 2024-09-15T22:57:12.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.206+0000 7f53c4ab5640 1 -- 172.21.15.28:0/4113918914 wait complete. 2024-09-15T22:57:12.225 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-15T22:57:11.881448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236832,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737888,"statfs":{"total":773094113280,"available":772851597312,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001743"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688426+0000","last_change":"2024-09-15T22:57:07.422481+0000","last_active":"2024-09-15T22:57:08.688426+0000","last_peered":"2024-09-15T22:57:08.688426+0000","last_clean":"2024-09-15T22:57:08.688426+0000","last_became_active":"2024-09-15T22:57:07.421724+0000","last_became_peered":"2024-09-15T22:57:07.421724+0000","last_unstale":"2024-09-15T22:57:08.688426+0000","last_undegraded":"2024-09-15T22:57:08.688426+0000","last_fullsized":"2024-09-15T22:57:08.688426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:05.395270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691428+0000","last_change":"2024-09-15T22:57:07.414811+0000","last_active":"2024-09-15T22:57:08.691428+0000","last_peered":"2024-09-15T22:57:08.691428+0000","last_clean":"2024-09-15T22:57:08.691428+0000","last_became_active":"2024-09-15T22:57:07.412780+0000","last_became_peered":"2024-09-15T22:57:07.412780+0000","last_unstale":"2024-09-15T22:57:08.691428+0000","last_undegraded":"2024-09-15T22:57:08.691428+0000","last_fullsized":"2024-09-15T22:57:08.691428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:34.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408209+0000","last_change":"2024-09-15T22:57:07.415251+0000","last_active":"2024-09-15T22:57:08.408209+0000","last_peered":"2024-09-15T22:57:08.408209+0000","last_clean":"2024-09-15T22:57:08.408209+0000","last_became_active":"2024-09-15T22:57:07.413708+0000","last_became_peered":"2024-09-15T22:57:07.413708+0000","last_unstale":"2024-09-15T22:57:08.408209+0000","last_undegraded":"2024-09-15T22:57:08.408209+0000","last_fullsized":"2024-09-15T22:57:08.408209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428567+0000","last_change":"2024-09-15T22:57:07.408039+0000","last_active":"2024-09-15T22:57:08.428567+0000","last_peered":"2024-09-15T22:57:08.428567+0000","last_clean":"2024-09-15T22:57:08.428567+0000","last_became_active":"2024-09-15T22:57:07.403618+0000","last_became_peered":"2024-09-15T22:57:07.403618+0000","last_unstale":"2024-09-15T22:57:08.428567+0000","last_undegraded":"2024-09-15T22:57:08.428567+0000","last_fullsized":"2024-09-15T22:57:08.428567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689773+0000","last_change":"2024-09-15T22:57:07.418137+0000","last_active":"2024-09-15T22:57:08.689773+0000","last_peered":"2024-09-15T22:57:08.689773+0000","last_clean":"2024-09-15T22:57:08.689773+0000","last_became_active":"2024-09-15T22:57:07.417768+0000","last_became_peered":"2024-09-15T22:57:07.417768+0000","last_unstale":"2024-09-15T22:57:08.689773+0000","last_undegraded":"2024-09-15T22:57:08.689773+0000","last_fullsized":"2024-09-15T22:57:08.689773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:40.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690489+0000","last_change":"2024-09-15T22:57:07.410791+0000","last_active":"2024-09-15T22:57:08.690489+0000","last_peered":"2024-09-15T22:57:08.690489+0000","last_clean":"2024-09-15T22:57:08.690489+0000","last_became_active":"2024-09-15T22:57:07.410385+0000","last_became_peered":"2024-09-15T22:57:07.410385+0000","last_unstale":"2024-09-15T22:57:08.690489+0000","last_undegraded":"2024-09-15T22:57:08.690489+0000","last_fullsized":"2024-09-15T22:57:08.690489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632493+0000","last_change":"2024-09-15T22:57:07.435315+0000","last_active":"2024-09-15T22:57:08.632493+0000","last_peered":"2024-09-15T22:57:08.632493+0000","last_clean":"2024-09-15T22:57:08.632493+0000","last_became_active":"2024-09-15T22:57:07.433936+0000","last_became_peered":"2024-09-15T22:57:07.433936+0000","last_unstale":"2024-09-15T22:57:08.632493+0000","last_undegraded":"2024-09-15T22:57:08.632493+0000","last_fullsized":"2024-09-15T22:57:08.632493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631705+0000","last_change":"2024-09-15T22:57:07.430306+0000","last_active":"2024-09-15T22:57:08.631705+0000","last_peered":"2024-09-15T22:57:08.631705+0000","last_clean":"2024-09-15T22:57:08.631705+0000","last_became_active":"2024-09-15T22:57:07.429327+0000","last_became_peered":"2024-09-15T22:57:07.429327+0000","last_unstale":"2024-09-15T22:57:08.631705+0000","last_undegraded":"2024-09-15T22:57:08.631705+0000","last_fullsized":"2024-09-15T22:57:08.631705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409967+0000","last_change":"2024-09-15T22:57:07.407409+0000","last_active":"2024-09-15T22:57:08.409967+0000","last_peered":"2024-09-15T22:57:08.409967+0000","last_clean":"2024-09-15T22:57:08.409967+0000","last_became_active":"2024-09-15T22:57:07.403239+0000","last_became_peered":"2024-09-15T22:57:07.403239+0000","last_unstale":"2024-09-15T22:57:08.409967+0000","last_undegraded":"2024-09-15T22:57:08.409967+0000","last_fullsized":"2024-09-15T22:57:08.409967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428974+0000","last_change":"2024-09-15T22:57:07.418481+0000","last_active":"2024-09-15T22:57:08.428974+0000","last_peered":"2024-09-15T22:57:08.428974+0000","last_clean":"2024-09-15T22:57:08.428974+0000","last_became_active":"2024-09-15T22:57:07.418179+0000","last_became_peered":"2024-09-15T22:57:07.418179+0000","last_unstale":"2024-09-15T22:57:08.428974+0000","last_undegraded":"2024-09-15T22:57:08.428974+0000","last_fullsized":"2024-09-15T22:57:08.428974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632496+0000","last_change":"2024-09-15T22:57:07.435002+0000","last_active":"2024-09-15T22:57:08.632496+0000","last_peered":"2024-09-15T22:57:08.632496+0000","last_clean":"2024-09-15T22:57:08.632496+0000","last_became_active":"2024-09-15T22:57:07.431791+0000","last_became_peered":"2024-09-15T22:57:07.431791+0000","last_unstale":"2024-09-15T22:57:08.632496+0000","last_undegraded":"2024-09-15T22:57:08.632496+0000","last_fullsized":"2024-09-15T22:57:08.632496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407709+0000","last_change":"2024-09-15T22:57:07.415567+0000","last_active":"2024-09-15T22:57:08.407709+0000","last_peered":"2024-09-15T22:57:08.407709+0000","last_clean":"2024-09-15T22:57:08.407709+0000","last_became_active":"2024-09-15T22:57:07.414859+0000","last_became_peered":"2024-09-15T22:57:07.414859+0000","last_unstale":"2024-09-15T22:57:08.407709+0000","last_undegraded":"2024-09-15T22:57:08.407709+0000","last_fullsized":"2024-09-15T22:57:08.407709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689796+0000","last_change":"2024-09-15T22:57:07.404912+0000","last_active":"2024-09-15T22:57:08.689796+0000","last_peered":"2024-09-15T22:57:08.689796+0000","last_clean":"2024-09-15T22:57:08.689796+0000","last_became_active":"2024-09-15T22:57:07.404646+0000","last_became_peered":"2024-09-15T22:57:07.404646+0000","last_unstale":"2024-09-15T22:57:08.689796+0000","last_undegraded":"2024-09-15T22:57:08.689796+0000","last_fullsized":"2024-09-15T22:57:08.689796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:59.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690626+0000","last_change":"2024-09-15T22:57:07.407611+0000","last_active":"2024-09-15T22:57:08.690626+0000","last_peered":"2024-09-15T22:57:08.690626+0000","last_clean":"2024-09-15T22:57:08.690626+0000","last_became_active":"2024-09-15T22:57:07.407094+0000","last_became_peered":"2024-09-15T22:57:07.407094+0000","last_unstale":"2024-09-15T22:57:08.690626+0000","last_undegraded":"2024-09-15T22:57:08.690626+0000","last_fullsized":"2024-09-15T22:57:08.690626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407468+0000","last_change":"2024-09-15T22:57:07.426899+0000","last_active":"2024-09-15T22:57:08.407468+0000","last_peered":"2024-09-15T22:57:08.407468+0000","last_clean":"2024-09-15T22:57:08.407468+0000","last_became_active":"2024-09-15T22:57:07.425429+0000","last_became_peered":"2024-09-15T22:57:07.425429+0000","last_unstale":"2024-09-15T22:57:08.407468+0000","last_undegraded":"2024-09-15T22:57:08.407468+0000","last_fullsized":"2024-09-15T22:57:08.407468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632524+0000","last_change":"2024-09-15T22:57:07.435259+0000","last_active":"2024-09-15T22:57:08.632524+0000","last_peered":"2024-09-15T22:57:08.632524+0000","last_clean":"2024-09-15T22:57:08.632524+0000","last_became_active":"2024-09-15T22:57:07.434672+0000","last_became_peered":"2024-09-15T22:57:07.434672+0000","last_unstale":"2024-09-15T22:57:08.632524+0000","last_undegraded":"2024-09-15T22:57:08.632524+0000","last_fullsized":"2024-09-15T22:57:08.632524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632732+0000","last_change":"2024-09-15T22:57:07.436431+0000","last_active":"2024-09-15T22:57:08.632732+0000","last_peered":"2024-09-15T22:57:08.632732+0000","last_clean":"2024-09-15T22:57:08.632732+0000","last_became_active":"2024-09-15T22:57:07.435624+0000","last_became_peered":"2024-09-15T22:57:07.435624+0000","last_unstale":"2024-09-15T22:57:08.632732+0000","last_undegraded":"2024-09-15T22:57:08.632732+0000","last_fullsized":"2024-09-15T22:57:08.632732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691316+0000","last_change":"2024-09-15T22:57:07.423612+0000","last_active":"2024-09-15T22:57:08.691316+0000","last_peered":"2024-09-15T22:57:08.691316+0000","last_clean":"2024-09-15T22:57:08.691316+0000","last_became_active":"2024-09-15T22:57:07.423279+0000","last_became_peered":"2024-09-15T22:57:07.423279+0000","last_unstale":"2024-09-15T22:57:08.691316+0000","last_undegraded":"2024-09-15T22:57:08.691316+0000","last_fullsized":"2024-09-15T22:57:08.691316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:18.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690687+0000","last_change":"2024-09-15T22:57:07.419227+0000","last_active":"2024-09-15T22:57:08.690687+0000","last_peered":"2024-09-15T22:57:08.690687+0000","last_clean":"2024-09-15T22:57:08.690687+0000","last_became_active":"2024-09-15T22:57:07.416882+0000","last_became_peered":"2024-09-15T22:57:07.416882+0000","last_unstale":"2024-09-15T22:57:08.690687+0000","last_undegraded":"2024-09-15T22:57:08.690687+0000","last_fullsized":"2024-09-15T22:57:08.690687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689823+0000","last_change":"2024-09-15T22:57:07.406087+0000","last_active":"2024-09-15T22:57:08.689823+0000","last_peered":"2024-09-15T22:57:08.689823+0000","last_clean":"2024-09-15T22:57:08.689823+0000","last_became_active":"2024-09-15T22:57:07.405688+0000","last_became_peered":"2024-09-15T22:57:07.405688+0000","last_unstale":"2024-09-15T22:57:08.689823+0000","last_undegraded":"2024-09-15T22:57:08.689823+0000","last_fullsized":"2024-09-15T22:57:08.689823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:32.357178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409112+0000","last_change":"2024-09-15T22:57:07.425157+0000","last_active":"2024-09-15T22:57:08.409112+0000","last_peered":"2024-09-15T22:57:08.409112+0000","last_clean":"2024-09-15T22:57:08.409112+0000","last_became_active":"2024-09-15T22:57:07.424459+0000","last_became_peered":"2024-09-15T22:57:07.424459+0000","last_unstale":"2024-09-15T22:57:08.409112+0000","last_undegraded":"2024-09-15T22:57:08.409112+0000","last_fullsized":"2024-09-15T22:57:08.409112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409214+0000","last_change":"2024-09-15T22:57:07.419020+0000","last_active":"2024-09-15T22:57:08.409214+0000","last_peered":"2024-09-15T22:57:08.409214+0000","last_clean":"2024-09-15T22:57:08.409214+0000","last_became_active":"2024-09-15T22:57:07.418272+0000","last_became_peered":"2024-09-15T22:57:07.418272+0000","last_unstale":"2024-09-15T22:57:08.409214+0000","last_undegraded":"2024-09-15T22:57:08.409214+0000","last_fullsized":"2024-09-15T22:57:08.409214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.405815+0000","last_change":"2024-09-15T22:57:07.414552+0000","last_active":"2024-09-15T22:57:08.405815+0000","last_peered":"2024-09-15T22:57:08.405815+0000","last_clean":"2024-09-15T22:57:08.405815+0000","last_became_active":"2024-09-15T22:57:07.414153+0000","last_became_peered":"2024-09-15T22:57:07.414153+0000","last_unstale":"2024-09-15T22:57:08.405815+0000","last_undegraded":"2024-09-15T22:57:08.405815+0000","last_fullsized":"2024-09-15T22:57:08.405815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:58.690688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406902+0000","last_change":"2024-09-15T22:57:07.407145+0000","last_active":"2024-09-15T22:57:08.406902+0000","last_peered":"2024-09-15T22:57:08.406902+0000","last_clean":"2024-09-15T22:57:08.406902+0000","last_became_active":"2024-09-15T22:57:07.406323+0000","last_became_peered":"2024-09-15T22:57:07.406323+0000","last_unstale":"2024-09-15T22:57:08.406902+0000","last_undegraded":"2024-09-15T22:57:08.406902+0000","last_fullsized":"2024-09-15T22:57:08.406902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429032+0000","last_change":"2024-09-15T22:57:07.438561+0000","last_active":"2024-09-15T22:57:08.429032+0000","last_peered":"2024-09-15T22:57:08.429032+0000","last_clean":"2024-09-15T22:57:08.429032+0000","last_became_active":"2024-09-15T22:57:07.438342+0000","last_became_peered":"2024-09-15T22:57:07.438342+0000","last_unstale":"2024-09-15T22:57:08.429032+0000","last_undegraded":"2024-09-15T22:57:08.429032+0000","last_fullsized":"2024-09-15T22:57:08.429032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691548+0000","last_change":"2024-09-15T22:57:07.414994+0000","last_active":"2024-09-15T22:57:08.691548+0000","last_peered":"2024-09-15T22:57:08.691548+0000","last_clean":"2024-09-15T22:57:08.691548+0000","last_became_active":"2024-09-15T22:57:07.414712+0000","last_became_peered":"2024-09-15T22:57:07.414712+0000","last_unstale":"2024-09-15T22:57:08.691548+0000","last_undegraded":"2024-09-15T22:57:08.691548+0000","last_fullsized":"2024-09-15T22:57:08.691548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:12.113967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429009+0000","last_change":"2024-09-15T22:57:07.413192+0000","last_active":"2024-09-15T22:57:08.429009+0000","last_peered":"2024-09-15T22:57:08.429009+0000","last_clean":"2024-09-15T22:57:08.429009+0000","last_became_active":"2024-09-15T22:57:07.411535+0000","last_became_peered":"2024-09-15T22:57:07.411535+0000","last_unstale":"2024-09-15T22:57:08.429009+0000","last_undegraded":"2024-09-15T22:57:08.429009+0000","last_fullsized":"2024-09-15T22:57:08.429009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407855+0000","last_change":"2024-09-15T22:57:07.396994+0000","last_active":"2024-09-15T22:57:08.407855+0000","last_peered":"2024-09-15T22:57:08.407855+0000","last_clean":"2024-09-15T22:57:08.407855+0000","last_became_active":"2024-09-15T22:57:07.395762+0000","last_became_peered":"2024-09-15T22:57:07.395762+0000","last_unstale":"2024-09-15T22:57:08.407855+0000","last_undegraded":"2024-09-15T22:57:08.407855+0000","last_fullsized":"2024-09-15T22:57:08.407855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409839+0000","last_change":"2024-09-15T22:57:07.419508+0000","last_active":"2024-09-15T22:57:08.409839+0000","last_peered":"2024-09-15T22:57:08.409839+0000","last_clean":"2024-09-15T22:57:08.409839+0000","last_became_active":"2024-09-15T22:57:07.418717+0000","last_became_peered":"2024-09-15T22:57:07.418717+0000","last_unstale":"2024-09-15T22:57:08.409839+0000","last_undegraded":"2024-09-15T22:57:08.409839+0000","last_fullsized":"2024-09-15T22:57:08.409839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631996+0000","last_change":"2024-09-15T22:57:07.434428+0000","last_active":"2024-09-15T22:57:08.631996+0000","last_peered":"2024-09-15T22:57:08.631996+0000","last_clean":"2024-09-15T22:57:08.631996+0000","last_became_active":"2024-09-15T22:57:07.433439+0000","last_became_peered":"2024-09-15T22:57:07.433439+0000","last_unstale":"2024-09-15T22:57:08.631996+0000","last_undegraded":"2024-09-15T22:57:08.631996+0000","last_fullsized":"2024-09-15T22:57:08.631996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688154+0000","last_change":"2024-09-15T22:57:07.422941+0000","last_active":"2024-09-15T22:57:08.688154+0000","last_peered":"2024-09-15T22:57:08.688154+0000","last_clean":"2024-09-15T22:57:08.688154+0000","last_became_active":"2024-09-15T22:57:07.422106+0000","last_became_peered":"2024-09-15T22:57:07.422106+0000","last_unstale":"2024-09-15T22:57:08.688154+0000","last_undegraded":"2024-09-15T22:57:08.688154+0000","last_fullsized":"2024-09-15T22:57:08.688154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.004375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631605+0000","last_change":"2024-09-15T22:57:07.434147+0000","last_active":"2024-09-15T22:57:08.631605+0000","last_peered":"2024-09-15T22:57:08.631605+0000","last_clean":"2024-09-15T22:57:08.631605+0000","last_became_active":"2024-09-15T22:57:07.433483+0000","last_became_peered":"2024-09-15T22:57:07.433483+0000","last_unstale":"2024-09-15T22:57:08.631605+0000","last_undegraded":"2024-09-15T22:57:08.631605+0000","last_fullsized":"2024-09-15T22:57:08.631605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406724+0000","last_change":"2024-09-15T22:57:07.431680+0000","last_active":"2024-09-15T22:57:08.406724+0000","last_peered":"2024-09-15T22:57:08.406724+0000","last_clean":"2024-09-15T22:57:08.406724+0000","last_became_active":"2024-09-15T22:57:07.431296+0000","last_became_peered":"2024-09-15T22:57:07.431296+0000","last_unstale":"2024-09-15T22:57:08.406724+0000","last_undegraded":"2024-09-15T22:57:08.406724+0000","last_fullsized":"2024-09-15T22:57:08.406724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688577+0000","last_change":"2024-09-15T22:57:06.414917+0000","last_active":"2024-09-15T22:57:08.688577+0000","last_peered":"2024-09-15T22:57:08.688577+0000","last_clean":"2024-09-15T22:57:08.688577+0000","last_became_active":"2024-09-15T22:57:06.414118+0000","last_became_peered":"2024-09-15T22:57:06.414118+0000","last_unstale":"2024-09-15T22:57:08.688577+0000","last_undegraded":"2024-09-15T22:57:08.688577+0000","last_fullsized":"2024-09-15T22:57:08.688577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688437+0000","last_change":"2024-09-15T22:57:07.409723+0000","last_active":"2024-09-15T22:57:08.688437+0000","last_peered":"2024-09-15T22:57:08.688437+0000","last_clean":"2024-09-15T22:57:08.688437+0000","last_became_active":"2024-09-15T22:57:07.409014+0000","last_became_peered":"2024-09-15T22:57:07.409014+0000","last_unstale":"2024-09-15T22:57:08.688437+0000","last_undegraded":"2024-09-15T22:57:08.688437+0000","last_fullsized":"2024-09-15T22:57:08.688437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:17.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406444+0000","last_change":"2024-09-15T22:57:06.412023+0000","last_active":"2024-09-15T22:57:08.406444+0000","last_peered":"2024-09-15T22:57:08.406444+0000","last_clean":"2024-09-15T22:57:08.406444+0000","last_became_active":"2024-09-15T22:57:06.411659+0000","last_became_peered":"2024-09-15T22:57:06.411659+0000","last_unstale":"2024-09-15T22:57:08.406444+0000","last_undegraded":"2024-09-15T22:57:08.406444+0000","last_fullsized":"2024-09-15T22:57:08.406444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409494+0000","last_change":"2024-09-15T22:57:07.423198+0000","last_active":"2024-09-15T22:57:08.409494+0000","last_peered":"2024-09-15T22:57:08.409494+0000","last_clean":"2024-09-15T22:57:08.409494+0000","last_became_active":"2024-09-15T22:57:07.422471+0000","last_became_peered":"2024-09-15T22:57:07.422471+0000","last_unstale":"2024-09-15T22:57:08.409494+0000","last_undegraded":"2024-09-15T22:57:08.409494+0000","last_fullsized":"2024-09-15T22:57:08.409494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691206+0000","last_change":"2024-09-15T22:57:06.396932+0000","last_active":"2024-09-15T22:57:08.691206+0000","last_peered":"2024-09-15T22:57:08.691206+0000","last_clean":"2024-09-15T22:57:08.691206+0000","last_became_active":"2024-09-15T22:57:06.396128+0000","last_became_peered":"2024-09-15T22:57:06.396128+0000","last_unstale":"2024-09-15T22:57:08.691206+0000","last_undegraded":"2024-09-15T22:57:08.691206+0000","last_fullsized":"2024-09-15T22:57:08.691206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:50.738771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429291+0000","last_change":"2024-09-15T22:57:07.413424+0000","last_active":"2024-09-15T22:57:08.429291+0000","last_peered":"2024-09-15T22:57:08.429291+0000","last_clean":"2024-09-15T22:57:08.429291+0000","last_became_active":"2024-09-15T22:57:07.411914+0000","last_became_peered":"2024-09-15T22:57:07.411914+0000","last_unstale":"2024-09-15T22:57:08.429291+0000","last_undegraded":"2024-09-15T22:57:08.429291+0000","last_fullsized":"2024-09-15T22:57:08.429291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689719+0000","last_change":"2024-09-15T22:57:06.389724+0000","last_active":"2024-09-15T22:57:08.689719+0000","last_peered":"2024-09-15T22:57:08.689719+0000","last_clean":"2024-09-15T22:57:08.689719+0000","last_became_active":"2024-09-15T22:57:06.389420+0000","last_became_peered":"2024-09-15T22:57:06.389420+0000","last_unstale":"2024-09-15T22:57:08.689719+0000","last_undegraded":"2024-09-15T22:57:08.689719+0000","last_fullsized":"2024-09-15T22:57:08.689719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:16.912850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632632+0000","last_change":"2024-09-15T22:57:07.434140+0000","last_active":"2024-09-15T22:57:08.632632+0000","last_peered":"2024-09-15T22:57:08.632632+0000","last_clean":"2024-09-15T22:57:08.632632+0000","last_became_active":"2024-09-15T22:57:07.432682+0000","last_became_peered":"2024-09-15T22:57:07.432682+0000","last_unstale":"2024-09-15T22:57:08.632632+0000","last_undegraded":"2024-09-15T22:57:08.632632+0000","last_fullsized":"2024-09-15T22:57:08.632632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409387+0000","last_change":"2024-09-15T22:57:06.406695+0000","last_active":"2024-09-15T22:57:08.409387+0000","last_peered":"2024-09-15T22:57:08.409387+0000","last_clean":"2024-09-15T22:57:08.409387+0000","last_became_active":"2024-09-15T22:57:06.405989+0000","last_became_peered":"2024-09-15T22:57:06.405989+0000","last_unstale":"2024-09-15T22:57:08.409387+0000","last_undegraded":"2024-09-15T22:57:08.409387+0000","last_fullsized":"2024-09-15T22:57:08.409387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407859+0000","last_change":"2024-09-15T22:57:07.415274+0000","last_active":"2024-09-15T22:57:08.407859+0000","last_peered":"2024-09-15T22:57:08.407859+0000","last_clean":"2024-09-15T22:57:08.407859+0000","last_became_active":"2024-09-15T22:57:07.414432+0000","last_became_peered":"2024-09-15T22:57:07.414432+0000","last_unstale":"2024-09-15T22:57:08.407859+0000","last_undegraded":"2024-09-15T22:57:08.407859+0000","last_fullsized":"2024-09-15T22:57:08.407859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409468+0000","last_change":"2024-09-15T22:57:06.406784+0000","last_active":"2024-09-15T22:57:08.409468+0000","last_peered":"2024-09-15T22:57:08.409468+0000","last_clean":"2024-09-15T22:57:08.409468+0000","last_became_active":"2024-09-15T22:57:06.406044+0000","last_became_peered":"2024-09-15T22:57:06.406044+0000","last_unstale":"2024-09-15T22:57:08.409468+0000","last_undegraded":"2024-09-15T22:57:08.409468+0000","last_fullsized":"2024-09-15T22:57:08.409468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:11.807980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407829+0000","last_change":"2024-09-15T22:57:07.426916+0000","last_active":"2024-09-15T22:57:08.407829+0000","last_peered":"2024-09-15T22:57:08.407829+0000","last_clean":"2024-09-15T22:57:08.407829+0000","last_became_active":"2024-09-15T22:57:07.426135+0000","last_became_peered":"2024-09-15T22:57:07.426135+0000","last_unstale":"2024-09-15T22:57:08.407829+0000","last_undegraded":"2024-09-15T22:57:08.407829+0000","last_fullsized":"2024-09-15T22:57:08.407829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688768+0000","last_change":"2024-09-15T22:57:06.396319+0000","last_active":"2024-09-15T22:57:08.688768+0000","last_peered":"2024-09-15T22:57:08.688768+0000","last_clean":"2024-09-15T22:57:08.688768+0000","last_became_active":"2024-09-15T22:57:06.395943+0000","last_became_peered":"2024-09-15T22:57:06.395943+0000","last_unstale":"2024-09-15T22:57:08.688768+0000","last_undegraded":"2024-09-15T22:57:08.688768+0000","last_fullsized":"2024-09-15T22:57:08.688768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428210+0000","last_change":"2024-09-15T22:57:07.427285+0000","last_active":"2024-09-15T22:57:08.428210+0000","last_peered":"2024-09-15T22:57:08.428210+0000","last_clean":"2024-09-15T22:57:08.428210+0000","last_became_active":"2024-09-15T22:57:07.426924+0000","last_became_peered":"2024-09-15T22:57:07.426924+0000","last_unstale":"2024-09-15T22:57:08.428210+0000","last_undegraded":"2024-09-15T22:57:08.428210+0000","last_fullsized":"2024-09-15T22:57:08.428210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408072+0000","last_change":"2024-09-15T22:57:06.403648+0000","last_active":"2024-09-15T22:57:08.408072+0000","last_peered":"2024-09-15T22:57:08.408072+0000","last_clean":"2024-09-15T22:57:08.408072+0000","last_became_active":"2024-09-15T22:57:06.402925+0000","last_became_peered":"2024-09-15T22:57:06.402925+0000","last_unstale":"2024-09-15T22:57:08.408072+0000","last_undegraded":"2024-09-15T22:57:08.408072+0000","last_fullsized":"2024-09-15T22:57:08.408072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408608+0000","last_change":"2024-09-15T22:57:07.408441+0000","last_active":"2024-09-15T22:57:08.408608+0000","last_peered":"2024-09-15T22:57:08.408608+0000","last_clean":"2024-09-15T22:57:08.408608+0000","last_became_active":"2024-09-15T22:57:07.407246+0000","last_became_peered":"2024-09-15T22:57:07.407246+0000","last_unstale":"2024-09-15T22:57:08.408608+0000","last_undegraded":"2024-09-15T22:57:08.408608+0000","last_fullsized":"2024-09-15T22:57:08.408608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691475+0000","last_change":"2024-09-15T22:57:06.415706+0000","last_active":"2024-09-15T22:57:08.691475+0000","last_peered":"2024-09-15T22:57:08.691475+0000","last_clean":"2024-09-15T22:57:08.691475+0000","last_became_active":"2024-09-15T22:57:06.415352+0000","last_became_peered":"2024-09-15T22:57:06.415352+0000","last_unstale":"2024-09-15T22:57:08.691475+0000","last_undegraded":"2024-09-15T22:57:08.691475+0000","last_fullsized":"2024-09-15T22:57:08.691475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:57.681781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691271+0000","last_change":"2024-09-15T22:57:07.420932+0000","last_active":"2024-09-15T22:57:08.691271+0000","last_peered":"2024-09-15T22:57:08.691271+0000","last_clean":"2024-09-15T22:57:08.691271+0000","last_became_active":"2024-09-15T22:57:07.420671+0000","last_became_peered":"2024-09-15T22:57:07.420671+0000","last_unstale":"2024-09-15T22:57:08.691271+0000","last_undegraded":"2024-09-15T22:57:08.691271+0000","last_fullsized":"2024-09-15T22:57:08.691271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406614+0000","last_change":"2024-09-15T22:57:06.399559+0000","last_active":"2024-09-15T22:57:08.406614+0000","last_peered":"2024-09-15T22:57:08.406614+0000","last_clean":"2024-09-15T22:57:08.406614+0000","last_became_active":"2024-09-15T22:57:06.399192+0000","last_became_peered":"2024-09-15T22:57:06.399192+0000","last_unstale":"2024-09-15T22:57:08.406614+0000","last_undegraded":"2024-09-15T22:57:08.406614+0000","last_fullsized":"2024-09-15T22:57:08.406614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690967+0000","last_change":"2024-09-15T22:57:07.415974+0000","last_active":"2024-09-15T22:57:08.690967+0000","last_peered":"2024-09-15T22:57:08.690967+0000","last_clean":"2024-09-15T22:57:08.690967+0000","last_became_active":"2024-09-15T22:57:07.415666+0000","last_became_peered":"2024-09-15T22:57:07.415666+0000","last_unstale":"2024-09-15T22:57:08.690967+0000","last_undegraded":"2024-09-15T22:57:08.690967+0000","last_fullsized":"2024-09-15T22:57:08.690967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408478+0000","last_change":"2024-09-15T22:57:06.416238+0000","last_active":"2024-09-15T22:57:08.408478+0000","last_peered":"2024-09-15T22:57:08.408478+0000","last_clean":"2024-09-15T22:57:08.408478+0000","last_became_active":"2024-09-15T22:57:06.415550+0000","last_became_peered":"2024-09-15T22:57:06.415550+0000","last_unstale":"2024-09-15T22:57:08.408478+0000","last_undegraded":"2024-09-15T22:57:08.408478+0000","last_fullsized":"2024-09-15T22:57:08.408478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407783+0000","last_change":"2024-09-15T22:57:07.415886+0000","last_active":"2024-09-15T22:57:08.407783+0000","last_peered":"2024-09-15T22:57:08.407783+0000","last_clean":"2024-09-15T22:57:08.407783+0000","last_became_active":"2024-09-15T22:57:07.414584+0000","last_became_peered":"2024-09-15T22:57:07.414584+0000","last_unstale":"2024-09-15T22:57:08.407783+0000","last_undegraded":"2024-09-15T22:57:08.407783+0000","last_fullsized":"2024-09-15T22:57:08.407783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691493+0000","last_change":"2024-09-15T22:57:06.397779+0000","last_active":"2024-09-15T22:57:08.691493+0000","last_peered":"2024-09-15T22:57:08.691493+0000","last_clean":"2024-09-15T22:57:08.691493+0000","last_became_active":"2024-09-15T22:57:06.396940+0000","last_became_peered":"2024-09-15T22:57:06.396940+0000","last_unstale":"2024-09-15T22:57:08.691493+0000","last_undegraded":"2024-09-15T22:57:08.691493+0000","last_fullsized":"2024-09-15T22:57:08.691493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428477+0000","last_change":"2024-09-15T22:57:07.427292+0000","last_active":"2024-09-15T22:57:08.428477+0000","last_peered":"2024-09-15T22:57:08.428477+0000","last_clean":"2024-09-15T22:57:08.428477+0000","last_became_active":"2024-09-15T22:57:07.426935+0000","last_became_peered":"2024-09-15T22:57:07.426935+0000","last_unstale":"2024-09-15T22:57:08.428477+0000","last_undegraded":"2024-09-15T22:57:08.428477+0000","last_fullsized":"2024-09-15T22:57:08.428477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409673+0000","last_change":"2024-09-15T22:57:06.419004+0000","last_active":"2024-09-15T22:57:08.409673+0000","last_peered":"2024-09-15T22:57:08.409673+0000","last_clean":"2024-09-15T22:57:08.409673+0000","last_became_active":"2024-09-15T22:57:06.418305+0000","last_became_peered":"2024-09-15T22:57:06.418305+0000","last_unstale":"2024-09-15T22:57:08.409673+0000","last_undegraded":"2024-09-15T22:57:08.409673+0000","last_fullsized":"2024-09-15T22:57:08.409673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690853+0000","last_change":"2024-09-15T22:57:07.420047+0000","last_active":"2024-09-15T22:57:08.690853+0000","last_peered":"2024-09-15T22:57:08.690853+0000","last_clean":"2024-09-15T22:57:08.690853+0000","last_became_active":"2024-09-15T22:57:07.419680+0000","last_became_peered":"2024-09-15T22:57:07.419680+0000","last_unstale":"2024-09-15T22:57:08.690853+0000","last_undegraded":"2024-09-15T22:57:08.690853+0000","last_fullsized":"2024-09-15T22:57:08.690853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428388+0000","last_change":"2024-09-15T22:57:06.397650+0000","last_active":"2024-09-15T22:57:08.428388+0000","last_peered":"2024-09-15T22:57:08.428388+0000","last_clean":"2024-09-15T22:57:08.428388+0000","last_became_active":"2024-09-15T22:57:06.397149+0000","last_became_peered":"2024-09-15T22:57:06.397149+0000","last_unstale":"2024-09-15T22:57:08.428388+0000","last_undegraded":"2024-09-15T22:57:08.428388+0000","last_fullsized":"2024-09-15T22:57:08.428388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632659+0000","last_change":"2024-09-15T22:57:07.434274+0000","last_active":"2024-09-15T22:57:08.632659+0000","last_peered":"2024-09-15T22:57:08.632659+0000","last_clean":"2024-09-15T22:57:08.632659+0000","last_became_active":"2024-09-15T22:57:07.433581+0000","last_became_peered":"2024-09-15T22:57:07.433581+0000","last_unstale":"2024-09-15T22:57:08.632659+0000","last_undegraded":"2024-09-15T22:57:08.632659+0000","last_fullsized":"2024-09-15T22:57:08.632659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690091+0000","last_change":"2024-09-15T22:57:06.414226+0000","last_active":"2024-09-15T22:57:08.690091+0000","last_peered":"2024-09-15T22:57:08.690091+0000","last_clean":"2024-09-15T22:57:08.690091+0000","last_became_active":"2024-09-15T22:57:06.413884+0000","last_became_peered":"2024-09-15T22:57:06.413884+0000","last_unstale":"2024-09-15T22:57:08.690091+0000","last_undegraded":"2024-09-15T22:57:08.690091+0000","last_fullsized":"2024-09-15T22:57:08.690091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.541726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688260+0000","last_change":"2024-09-15T22:57:07.410462+0000","last_active":"2024-09-15T22:57:08.688260+0000","last_peered":"2024-09-15T22:57:08.688260+0000","last_clean":"2024-09-15T22:57:08.688260+0000","last_became_active":"2024-09-15T22:57:07.409146+0000","last_became_peered":"2024-09-15T22:57:07.409146+0000","last_unstale":"2024-09-15T22:57:08.688260+0000","last_undegraded":"2024-09-15T22:57:08.688260+0000","last_fullsized":"2024-09-15T22:57:08.688260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.835015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688862+0000","last_change":"2024-09-15T22:57:06.396109+0000","last_active":"2024-09-15T22:57:08.688862+0000","last_peered":"2024-09-15T22:57:08.688862+0000","last_clean":"2024-09-15T22:57:08.688862+0000","last_became_active":"2024-09-15T22:57:06.395817+0000","last_became_peered":"2024-09-15T22:57:06.395817+0000","last_unstale":"2024-09-15T22:57:08.688862+0000","last_undegraded":"2024-09-15T22:57:08.688862+0000","last_fullsized":"2024-09-15T22:57:08.688862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:16.048300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409208+0000","last_change":"2024-09-15T22:57:07.402992+0000","last_active":"2024-09-15T22:57:08.409208+0000","last_peered":"2024-09-15T22:57:08.409208+0000","last_clean":"2024-09-15T22:57:08.409208+0000","last_became_active":"2024-09-15T22:57:07.402275+0000","last_became_peered":"2024-09-15T22:57:07.402275+0000","last_unstale":"2024-09-15T22:57:08.409208+0000","last_undegraded":"2024-09-15T22:57:08.409208+0000","last_fullsized":"2024-09-15T22:57:08.409208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429096+0000","last_change":"2024-09-15T22:57:06.399079+0000","last_active":"2024-09-15T22:57:08.429096+0000","last_peered":"2024-09-15T22:57:08.429096+0000","last_clean":"2024-09-15T22:57:08.429096+0000","last_became_active":"2024-09-15T22:57:06.398592+0000","last_became_peered":"2024-09-15T22:57:06.398592+0000","last_unstale":"2024-09-15T22:57:08.429096+0000","last_undegraded":"2024-09-15T22:57:08.429096+0000","last_fullsized":"2024-09-15T22:57:08.429096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408814+0000","last_change":"2024-09-15T22:57:07.392962+0000","last_active":"2024-09-15T22:57:08.408814+0000","last_peered":"2024-09-15T22:57:08.408814+0000","last_clean":"2024-09-15T22:57:08.408814+0000","last_became_active":"2024-09-15T22:57:07.392136+0000","last_became_peered":"2024-09-15T22:57:07.392136+0000","last_unstale":"2024-09-15T22:57:08.408814+0000","last_undegraded":"2024-09-15T22:57:08.408814+0000","last_fullsized":"2024-09-15T22:57:08.408814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409439+0000","last_change":"2024-09-15T22:57:06.403454+0000","last_active":"2024-09-15T22:57:08.409439+0000","last_peered":"2024-09-15T22:57:08.409439+0000","last_clean":"2024-09-15T22:57:08.409439+0000","last_became_active":"2024-09-15T22:57:06.402754+0000","last_became_peered":"2024-09-15T22:57:06.402754+0000","last_unstale":"2024-09-15T22:57:08.409439+0000","last_undegraded":"2024-09-15T22:57:08.409439+0000","last_fullsized":"2024-09-15T22:57:08.409439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428445+0000","last_change":"2024-09-15T22:57:07.416567+0000","last_active":"2024-09-15T22:57:08.428445+0000","last_peered":"2024-09-15T22:57:08.428445+0000","last_clean":"2024-09-15T22:57:08.428445+0000","last_became_active":"2024-09-15T22:57:07.416211+0000","last_became_peered":"2024-09-15T22:57:07.416211+0000","last_unstale":"2024-09-15T22:57:08.428445+0000","last_undegraded":"2024-09-15T22:57:08.428445+0000","last_fullsized":"2024-09-15T22:57:08.428445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409205+0000","last_change":"2024-09-15T22:57:06.392051+0000","last_active":"2024-09-15T22:57:08.409205+0000","last_peered":"2024-09-15T22:57:08.409205+0000","last_clean":"2024-09-15T22:57:08.409205+0000","last_became_active":"2024-09-15T22:57:06.391291+0000","last_became_peered":"2024-09-15T22:57:06.391291+0000","last_unstale":"2024-09-15T22:57:08.409205+0000","last_undegraded":"2024-09-15T22:57:08.409205+0000","last_fullsized":"2024-09-15T22:57:08.409205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689677+0000","last_change":"2024-09-15T22:57:07.404167+0000","last_active":"2024-09-15T22:57:08.689677+0000","last_peered":"2024-09-15T22:57:08.689677+0000","last_clean":"2024-09-15T22:57:08.689677+0000","last_became_active":"2024-09-15T22:57:07.403777+0000","last_became_peered":"2024-09-15T22:57:07.403777+0000","last_unstale":"2024-09-15T22:57:08.689677+0000","last_undegraded":"2024-09-15T22:57:08.689677+0000","last_fullsized":"2024-09-15T22:57:08.689677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:48.121142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409721+0000","last_change":"2024-09-15T22:57:06.401089+0000","last_active":"2024-09-15T22:57:08.409721+0000","last_peered":"2024-09-15T22:57:08.409721+0000","last_clean":"2024-09-15T22:57:08.409721+0000","last_became_active":"2024-09-15T22:57:06.394169+0000","last_became_peered":"2024-09-15T22:57:06.394169+0000","last_unstale":"2024-09-15T22:57:08.409721+0000","last_undegraded":"2024-09-15T22:57:08.409721+0000","last_fullsized":"2024-09-15T22:57:08.409721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689807+0000","last_change":"2024-09-15T22:57:07.402811+0000","last_active":"2024-09-15T22:57:08.689807+0000","last_peered":"2024-09-15T22:57:08.689807+0000","last_clean":"2024-09-15T22:57:08.689807+0000","last_became_active":"2024-09-15T22:57:07.401817+0000","last_became_peered":"2024-09-15T22:57:07.401817+0000","last_unstale":"2024-09-15T22:57:08.689807+0000","last_undegraded":"2024-09-15T22:57:08.689807+0000","last_fullsized":"2024-09-15T22:57:08.689807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:15.684506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406524+0000","last_change":"2024-09-15T22:57:06.391113+0000","last_active":"2024-09-15T22:57:08.406524+0000","last_peered":"2024-09-15T22:57:08.406524+0000","last_clean":"2024-09-15T22:57:08.406524+0000","last_became_active":"2024-09-15T22:57:06.390708+0000","last_became_peered":"2024-09-15T22:57:06.390708+0000","last_unstale":"2024-09-15T22:57:08.406524+0000","last_undegraded":"2024-09-15T22:57:08.406524+0000","last_fullsized":"2024-09-15T22:57:08.406524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690203+0000","last_change":"2024-09-15T22:57:07.415492+0000","last_active":"2024-09-15T22:57:08.690203+0000","last_peered":"2024-09-15T22:57:08.690203+0000","last_clean":"2024-09-15T22:57:08.690203+0000","last_became_active":"2024-09-15T22:57:07.415101+0000","last_became_peered":"2024-09-15T22:57:07.415101+0000","last_unstale":"2024-09-15T22:57:08.690203+0000","last_undegraded":"2024-09-15T22:57:08.690203+0000","last_fullsized":"2024-09-15T22:57:08.690203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:12.051194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688138+0000","last_change":"2024-09-15T22:57:06.410239+0000","last_active":"2024-09-15T22:57:08.688138+0000","last_peered":"2024-09-15T22:57:08.688138+0000","last_clean":"2024-09-15T22:57:08.688138+0000","last_became_active":"2024-09-15T22:57:06.408665+0000","last_became_peered":"2024-09-15T22:57:06.408665+0000","last_unstale":"2024-09-15T22:57:08.688138+0000","last_undegraded":"2024-09-15T22:57:08.688138+0000","last_fullsized":"2024-09-15T22:57:08.688138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689271+0000","last_change":"2024-09-15T22:57:07.412078+0000","last_active":"2024-09-15T22:57:08.689271+0000","last_peered":"2024-09-15T22:57:08.689271+0000","last_clean":"2024-09-15T22:57:08.689271+0000","last_became_active":"2024-09-15T22:57:07.411701+0000","last_became_peered":"2024-09-15T22:57:07.411701+0000","last_unstale":"2024-09-15T22:57:08.689271+0000","last_undegraded":"2024-09-15T22:57:08.689271+0000","last_fullsized":"2024-09-15T22:57:08.689271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:15.244770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.410091+0000","last_change":"2024-09-15T22:57:06.399953+0000","last_active":"2024-09-15T22:57:08.410091+0000","last_peered":"2024-09-15T22:57:08.410091+0000","last_clean":"2024-09-15T22:57:08.410091+0000","last_became_active":"2024-09-15T22:57:06.398273+0000","last_became_peered":"2024-09-15T22:57:06.398273+0000","last_unstale":"2024-09-15T22:57:08.410091+0000","last_undegraded":"2024-09-15T22:57:08.410091+0000","last_fullsized":"2024-09-15T22:57:08.410091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:14.235863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631880+0000","last_change":"2024-09-15T22:57:07.434347+0000","last_active":"2024-09-15T22:57:08.631880+0000","last_peered":"2024-09-15T22:57:08.631880+0000","last_clean":"2024-09-15T22:57:08.631880+0000","last_became_active":"2024-09-15T22:57:07.433210+0000","last_became_peered":"2024-09-15T22:57:07.433210+0000","last_unstale":"2024-09-15T22:57:08.631880+0000","last_undegraded":"2024-09-15T22:57:08.631880+0000","last_fullsized":"2024-09-15T22:57:08.631880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407147+0000","last_change":"2024-09-15T22:57:06.416531+0000","last_active":"2024-09-15T22:57:08.407147+0000","last_peered":"2024-09-15T22:57:08.407147+0000","last_clean":"2024-09-15T22:57:08.407147+0000","last_became_active":"2024-09-15T22:57:06.415794+0000","last_became_peered":"2024-09-15T22:57:06.415794+0000","last_unstale":"2024-09-15T22:57:08.407147+0000","last_undegraded":"2024-09-15T22:57:08.407147+0000","last_fullsized":"2024-09-15T22:57:08.407147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689263+0000","last_change":"2024-09-15T22:57:07.404294+0000","last_active":"2024-09-15T22:57:08.689263+0000","last_peered":"2024-09-15T22:57:08.689263+0000","last_clean":"2024-09-15T22:57:08.689263+0000","last_became_active":"2024-09-15T22:57:07.403987+0000","last_became_peered":"2024-09-15T22:57:07.403987+0000","last_unstale":"2024-09-15T22:57:08.689263+0000","last_undegraded":"2024-09-15T22:57:08.689263+0000","last_fullsized":"2024-09-15T22:57:08.689263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:12.816887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429123+0000","last_change":"2024-09-15T22:57:06.409400+0000","last_active":"2024-09-15T22:57:08.429123+0000","last_peered":"2024-09-15T22:57:08.429123+0000","last_clean":"2024-09-15T22:57:08.429123+0000","last_became_active":"2024-09-15T22:57:06.409087+0000","last_became_peered":"2024-09-15T22:57:06.409087+0000","last_unstale":"2024-09-15T22:57:08.429123+0000","last_undegraded":"2024-09-15T22:57:08.429123+0000","last_fullsized":"2024-09-15T22:57:08.429123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409189+0000","last_change":"2024-09-15T22:57:07.412280+0000","last_active":"2024-09-15T22:57:08.409189+0000","last_peered":"2024-09-15T22:57:08.409189+0000","last_clean":"2024-09-15T22:57:08.409189+0000","last_became_active":"2024-09-15T22:57:07.410996+0000","last_became_peered":"2024-09-15T22:57:07.410996+0000","last_unstale":"2024-09-15T22:57:08.409189+0000","last_undegraded":"2024-09-15T22:57:08.409189+0000","last_fullsized":"2024-09-15T22:57:08.409189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.426761+0000","last_change":"2024-09-15T22:57:06.392231+0000","last_active":"2024-09-15T22:57:08.426761+0000","last_peered":"2024-09-15T22:57:08.426761+0000","last_clean":"2024-09-15T22:57:08.426761+0000","last_became_active":"2024-09-15T22:57:06.391825+0000","last_became_peered":"2024-09-15T22:57:06.391825+0000","last_unstale":"2024-09-15T22:57:08.426761+0000","last_undegraded":"2024-09-15T22:57:08.426761+0000","last_fullsized":"2024-09-15T22:57:08.426761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:39.096197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406616+0000","last_change":"2024-09-15T22:57:07.419511+0000","last_active":"2024-09-15T22:57:08.406616+0000","last_peered":"2024-09-15T22:57:08.406616+0000","last_clean":"2024-09-15T22:57:08.406616+0000","last_became_active":"2024-09-15T22:57:07.419226+0000","last_became_peered":"2024-09-15T22:57:07.419226+0000","last_unstale":"2024-09-15T22:57:08.406616+0000","last_undegraded":"2024-09-15T22:57:08.406616+0000","last_fullsized":"2024-09-15T22:57:08.406616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428677+0000","last_change":"2024-09-15T22:57:06.389493+0000","last_active":"2024-09-15T22:57:08.428677+0000","last_peered":"2024-09-15T22:57:08.428677+0000","last_clean":"2024-09-15T22:57:08.428677+0000","last_became_active":"2024-09-15T22:57:06.389159+0000","last_became_peered":"2024-09-15T22:57:06.389159+0000","last_unstale":"2024-09-15T22:57:08.428677+0000","last_undegraded":"2024-09-15T22:57:08.428677+0000","last_fullsized":"2024-09-15T22:57:08.428677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:16.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.687979+0000","last_change":"2024-09-15T22:57:07.414543+0000","last_active":"2024-09-15T22:57:08.687979+0000","last_peered":"2024-09-15T22:57:08.687979+0000","last_clean":"2024-09-15T22:57:08.687979+0000","last_became_active":"2024-09-15T22:57:07.413850+0000","last_became_peered":"2024-09-15T22:57:07.413850+0000","last_unstale":"2024-09-15T22:57:08.687979+0000","last_undegraded":"2024-09-15T22:57:08.687979+0000","last_fullsized":"2024-09-15T22:57:08.687979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:43.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406669+0000","last_change":"2024-09-15T22:57:06.399871+0000","last_active":"2024-09-15T22:57:08.406669+0000","last_peered":"2024-09-15T22:57:08.406669+0000","last_clean":"2024-09-15T22:57:08.406669+0000","last_became_active":"2024-09-15T22:57:06.399238+0000","last_became_peered":"2024-09-15T22:57:06.399238+0000","last_unstale":"2024-09-15T22:57:08.406669+0000","last_undegraded":"2024-09-15T22:57:08.406669+0000","last_fullsized":"2024-09-15T22:57:08.406669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406470+0000","last_change":"2024-09-15T22:57:07.412429+0000","last_active":"2024-09-15T22:57:08.406470+0000","last_peered":"2024-09-15T22:57:08.406470+0000","last_clean":"2024-09-15T22:57:08.406470+0000","last_became_active":"2024-09-15T22:57:07.412103+0000","last_became_peered":"2024-09-15T22:57:07.412103+0000","last_unstale":"2024-09-15T22:57:08.406470+0000","last_undegraded":"2024-09-15T22:57:08.406470+0000","last_fullsized":"2024-09-15T22:57:08.406470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428622+0000","last_change":"2024-09-15T22:57:06.409462+0000","last_active":"2024-09-15T22:57:08.428622+0000","last_peered":"2024-09-15T22:57:08.428622+0000","last_clean":"2024-09-15T22:57:08.428622+0000","last_became_active":"2024-09-15T22:57:06.408985+0000","last_became_peered":"2024-09-15T22:57:06.408985+0000","last_unstale":"2024-09-15T22:57:08.428622+0000","last_undegraded":"2024-09-15T22:57:08.428622+0000","last_fullsized":"2024-09-15T22:57:08.428622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688853+0000","last_change":"2024-09-15T22:57:07.411144+0000","last_active":"2024-09-15T22:57:08.688853+0000","last_peered":"2024-09-15T22:57:08.688853+0000","last_clean":"2024-09-15T22:57:08.688853+0000","last_became_active":"2024-09-15T22:57:07.410852+0000","last_became_peered":"2024-09-15T22:57:07.410852+0000","last_unstale":"2024-09-15T22:57:08.688853+0000","last_undegraded":"2024-09-15T22:57:08.688853+0000","last_fullsized":"2024-09-15T22:57:08.688853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409437+0000","last_change":"2024-09-15T22:57:06.400623+0000","last_active":"2024-09-15T22:57:08.409437+0000","last_peered":"2024-09-15T22:57:08.409437+0000","last_clean":"2024-09-15T22:57:08.409437+0000","last_became_active":"2024-09-15T22:57:06.399225+0000","last_became_peered":"2024-09-15T22:57:06.399225+0000","last_unstale":"2024-09-15T22:57:08.409437+0000","last_undegraded":"2024-09-15T22:57:08.409437+0000","last_fullsized":"2024-09-15T22:57:08.409437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:47.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408611+0000","last_change":"2024-09-15T22:57:07.421477+0000","last_active":"2024-09-15T22:57:08.408611+0000","last_peered":"2024-09-15T22:57:08.408611+0000","last_clean":"2024-09-15T22:57:08.408611+0000","last_became_active":"2024-09-15T22:57:07.420757+0000","last_became_peered":"2024-09-15T22:57:07.420757+0000","last_unstale":"2024-09-15T22:57:08.408611+0000","last_undegraded":"2024-09-15T22:57:08.408611+0000","last_fullsized":"2024-09-15T22:57:08.408611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689138+0000","last_change":"2024-09-15T22:57:06.415777+0000","last_active":"2024-09-15T22:57:08.689138+0000","last_peered":"2024-09-15T22:57:08.689138+0000","last_clean":"2024-09-15T22:57:08.689138+0000","last_became_active":"2024-09-15T22:57:06.415336+0000","last_became_peered":"2024-09-15T22:57:06.415336+0000","last_unstale":"2024-09-15T22:57:08.689138+0000","last_undegraded":"2024-09-15T22:57:08.689138+0000","last_fullsized":"2024-09-15T22:57:08.689138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:04.386363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632259+0000","last_change":"2024-09-15T22:57:07.432549+0000","last_active":"2024-09-15T22:57:08.632259+0000","last_peered":"2024-09-15T22:57:08.632259+0000","last_clean":"2024-09-15T22:57:08.632259+0000","last_became_active":"2024-09-15T22:57:07.431846+0000","last_became_peered":"2024-09-15T22:57:07.431846+0000","last_unstale":"2024-09-15T22:57:08.632259+0000","last_undegraded":"2024-09-15T22:57:08.632259+0000","last_fullsized":"2024-09-15T22:57:08.632259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688106+0000","last_change":"2024-09-15T22:57:06.412303+0000","last_active":"2024-09-15T22:57:08.688106+0000","last_peered":"2024-09-15T22:57:08.688106+0000","last_clean":"2024-09-15T22:57:08.688106+0000","last_became_active":"2024-09-15T22:57:06.411608+0000","last_became_peered":"2024-09-15T22:57:06.411608+0000","last_unstale":"2024-09-15T22:57:08.688106+0000","last_undegraded":"2024-09-15T22:57:08.688106+0000","last_fullsized":"2024-09-15T22:57:08.688106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632679+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:08.632679+0000","last_peered":"2024-09-15T22:57:08.632679+0000","last_clean":"2024-09-15T22:57:08.632679+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:08.632679+0000","last_undegraded":"2024-09-15T22:57:08.632679+0000","last_fullsized":"2024-09-15T22:57:08.632679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:12.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:57:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 Processor -- start 2024-09-15T22:57:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 -- start start 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440cf7e0 0x7fb64415d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6440b3fc0 0x7fb6440b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64415c870 con 0x7fb644159d20 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb6440cfbf0 con 0x7fb6440b3fc0 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb64b77b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb64415d870 con 0x7fb6440cf7e0 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6440b3fc0 0x7fb6440b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6440b3fc0 0x7fb6440b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58032/0 (socket says 172.21.15.28:58032) 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 -- 172.21.15.28:0/3003882933 learned_addr learned my addr 172.21.15.28:0/3003882933 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb648d16640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440cf7e0 0x7fb64415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 -- 172.21.15.28:0/3003882933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440cf7e0 msgr2=0x7fb64415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440cf7e0 0x7fb64415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 -- 172.21.15.28:0/3003882933 >> v1:172.21.15.131:6789/0 conn(0x7fb644159d20 legacy=0x7fb6440d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.394+0000 7fb649d18640 1 -- 172.21.15.28:0/3003882933 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440d0920 con 0x7fb6440b3fc0 2024-09-15T22:57:12.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb649d18640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6440b3fc0 0x7fb6440b4470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009e50 tx=0x7fb63c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f2e8f28d6c2c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb63bfff640 1 -- 172.21.15.28:0/3003882933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a57f0 con 0x7fb6440b3fc0 2024-09-15T22:57:12.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb63bfff640 1 -- 172.21.15.28:0/3003882933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0a5990 con 0x7fb6440b3fc0 2024-09-15T22:57:12.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb63bfff640 1 -- 172.21.15.28:0/3003882933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a5d60 con 0x7fb6440b3fc0 2024-09-15T22:57:12.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- 172.21.15.28:0/3003882933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6440b3fc0 msgr2=0x7fb6440b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6440b3fc0 0x7fb6440b4470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009e50 tx=0x7fb63c01ca30 comp rx=0 tx=0).stop 2024-09-15T22:57:12.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- 172.21.15.28:0/3003882933 shutdown_connections 2024-09-15T22:57:12.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6440b3fc0 0x7fb6440b4470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 --2- 172.21.15.28:0/3003882933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440cf7e0 0x7fb64415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- 172.21.15.28:0/3003882933 >> 172.21.15.28:0/3003882933 conn(0x7fb64406be90 msgr2=0x7fb64406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- 172.21.15.28:0/3003882933 shutdown_connections 2024-09-15T22:57:12.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- 172.21.15.28:0/3003882933 wait complete. 2024-09-15T22:57:12.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 Processor -- start 2024-09-15T22:57:12.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.398+0000 7fb64b77b640 1 -- start start 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 0x7fb644152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 0x7fb6440b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb64415a280 con 0x7fb644159d20 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb64415a100 con 0x7fb6440cf7e0 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb6440b5cf0 con 0x7fb6440b3fc0 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58048/0 (socket says 172.21.15.28:58048) 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 -- 172.21.15.28:0/1572958004 learned_addr learned my addr 172.21.15.28:0/1572958004 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb648d16640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 0x7fb6440b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 -- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 msgr2=0x7fb644152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649517640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 0x7fb644152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 0x7fb644152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 -- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 msgr2=0x7fb6440b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 0x7fb6440b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 -- 172.21.15.28:0/1572958004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb644152bb0 con 0x7fb644159d20 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649517640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 0x7fb644152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb648d16640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 0x7fb6440b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649d18640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01a660 tx=0x7fb63c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b8670 con 0x7fb644159d20 2024-09-15T22:57:12.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0be070 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb644152e90 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b8a70 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb644153450 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6440b5ff0 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb63c0b8c10 con 0x7fb644159d20 2024-09-15T22:57:12.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 0x7fb628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb63c120e50 con 0x7fb644159d20 2024-09-15T22:57:12.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649517640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 0x7fb628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.402+0000 7fb649517640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 0x7fb628069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb640000f70 tx=0x7fb640009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.406+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb63c016620 con 0x7fb644159d20 2024-09-15T22:57:12.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb64414f690 con 0x7fb644159d20 2024-09-15T22:57:12.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb639ffb640 1 -- 172.21.15.28:0/1572958004 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1602 (secure 0 0 0) 0x7fb63c0f1a50 con 0x7fb644159d20 2024-09-15T22:57:12.638 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:12.639 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440969,"num_in_osds":8,"osd_in_since":1726440959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":242515968,"bytes_avail":772851597312,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"btime":"2024-09-15T22:57:10:415033+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4806}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T22:57:11.881675+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:57:12.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 msgr2=0x7fb628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 0x7fb628069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb640000f70 tx=0x7fb640009040 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 msgr2=0x7fb6441549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb63c01a660 tx=0x7fb63c0197d0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 shutdown_connections 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb644159d20 0x7fb6441549e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb6280678c0 0x7fb628069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6440cf7e0 0x7fb6440b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 --2- 172.21.15.28:0/1572958004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6440b3fc0 0x7fb644152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 >> 172.21.15.28:0/1572958004 conn(0x7fb64406be90 msgr2=0x7fb6440d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 shutdown_connections 2024-09-15T22:57:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.638+0000 7fb64b77b640 1 -- 172.21.15.28:0/1572958004 wait complete. 2024-09-15T22:57:12.658 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:57:12.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 Processor -- start 2024-09-15T22:57:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 -- start start 2024-09-15T22:57:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbf1c0ceac0 0x7fbf1c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1c0d0960 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1c0d0c40 con 0x7fbf1c145970 2024-09-15T22:57:12.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf21c77640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1c0d0f20 con 0x7fbf1c0ceac0 2024-09-15T22:57:12.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf13fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbf1c0b24d0 0x7fbf1c0cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36978/0 (socket says 172.21.15.28:36978) 2024-09-15T22:57:12.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf13fff640 1 -- 172.21.15.28:0/3146205441 learned_addr learned my addr 172.21.15.28:0/3146205441 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3205610087 0 0) 0x7fbf1c0d0960 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 --2- 172.21.15.28:0/3146205441 >> v2:172.21.15.131:3300/0 conn(0x7fbf1c0ceac0 0x7fbf1c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08003530 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2966968942 0 0) 0x7fbf08003530 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 >> v2:172.21.15.131:3300/0 conn(0x7fbf1c0ceac0 msgr2=0x7fbf1c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 --2- 172.21.15.28:0/3146205441 >> v2:172.21.15.131:3300/0 conn(0x7fbf1c0ceac0 0x7fbf1c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 >> v1:172.21.15.131:6789/0 conn(0x7fbf1c145970 legacy=0x7fbf1c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c0cd2b0 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fbf04001680 con 0x7fbf1c0b24d0 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 >> v1:172.21.15.28:6789/0 conn(0x7fbf1c0b24d0 legacy=0x7fbf1c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf080039c0 0x7fbf08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf08004810 0x7fbf08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0d0f20 con 0x7fbf08005220 2024-09-15T22:57:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0800c150 con 0x7fbf08004810 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0800c350 con 0x7fbf080039c0 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf13fff640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf08004810 0x7fbf08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1b7fe640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf080039c0 0x7fbf08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 -- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf080039c0 msgr2=0x7fbf08003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf080039c0 0x7fbf08003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 -- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf08004810 msgr2=0x7fbf08004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf08004810 0x7fbf08004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.778+0000 7fbf1bfff640 1 -- 172.21.15.28:0/3146205441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf08003530 con 0x7fbf08005220 2024-09-15T22:57:12.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf1bfff640 1 -- 172.21.15.28:0/3146205441 reap_dead start 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf1bfff640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf0800b9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009fa0 tx=0x7fbf1401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54652ae62a6ffab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140b2070 con 0x7fbf08005220 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf140a5c40 con 0x7fbf08005220 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf1affd640 1 -- 172.21.15.28:0/3146205441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14009bf0 con 0x7fbf08005220 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 msgr2=0x7fbf0800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf0800b9d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009fa0 tx=0x7fbf1401cc80 comp rx=0 tx=0).stop 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- 172.21.15.28:0/3146205441 shutdown_connections 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 --2- 172.21.15.28:0/3146205441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf0800b9d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- 172.21.15.28:0/3146205441 >> 172.21.15.28:0/3146205441 conn(0x7fbf1c06bcc0 msgr2=0x7fbf1c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- 172.21.15.28:0/3146205441 shutdown_connections 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- 172.21.15.28:0/3146205441 wait complete. 2024-09-15T22:57:12.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 Processor -- start 2024-09-15T22:57:12.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.782+0000 7fbf21c77640 1 -- start start 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c13bac0 0x7fbf1c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf1c0aedf0 0x7fbf1c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0b1dc0 con 0x7fbf08005220 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c0cd620 con 0x7fbf1c13bac0 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c0b1f40 con 0x7fbf1c0aedf0 2024-09-15T22:57:12.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58078/0 (socket says 172.21.15.28:58078) 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 -- 172.21.15.28:0/4066752120 learned_addr learned my addr 172.21.15.28:0/4066752120 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 -- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf1c0aedf0 msgr2=0x7fbf1c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf1c0aedf0 0x7fbf1c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 -- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c13bac0 msgr2=0x7fbf1c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c13bac0 0x7fbf1c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 -- 172.21.15.28:0/4066752120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c13c230 con 0x7fbf08005220 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf1b7fe640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e4e0 tx=0x7fbf0c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0052e0 con 0x7fbf08005220 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c018070 con 0x7fbf08005220 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c13c510 con 0x7fbf08005220 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c005480 con 0x7fbf08005220 2024-09-15T22:57:12.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c13cad0 con 0x7fbf08005220 2024-09-15T22:57:12.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1c072fb0 con 0x7fbf08005220 2024-09-15T22:57:12.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf0c003840 con 0x7fbf08005220 2024-09-15T22:57:12.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 0x7fbefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c0858d0 con 0x7fbf08005220 2024-09-15T22:57:12.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf13fff640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 0x7fbefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.786+0000 7fbf13fff640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 0x7fbefc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf04001a20 tx=0x7fbf040019b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.790+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf0c056410 con 0x7fbf08005220 2024-09-15T22:57:12.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.950+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf1c0af220 con 0x7fbefc0678c0 2024-09-15T22:57:12.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.966+0000 7fbf18ff9640 1 -- 172.21.15.28:0/4066752120 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7fbf04005730 con 0x7fbefc0678c0 2024-09-15T22:57:12.971 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:12.972 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:12.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 msgr2=0x7fbefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 0x7fbefc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf04001a20 tx=0x7fbf040019b0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 msgr2=0x7fbf1c13d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e4e0 tx=0x7fbf0c00e9a0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 shutdown_connections 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf1c0aedf0 0x7fbf1c0b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbefc0678c0 0x7fbefc069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf1c13bac0 0x7fbf1c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 --2- 172.21.15.28:0/4066752120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf08005220 0x7fbf1c13d2d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 >> 172.21.15.28:0/4066752120 conn(0x7fbf1c06bcc0 msgr2=0x7fbf1c0734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 shutdown_connections 2024-09-15T22:57:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:12.970+0000 7fbf21c77640 1 -- 172.21.15.28:0/4066752120 wait complete. 2024-09-15T22:57:12.988 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-15T22:57:11.881448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236832,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737888,"statfs":{"total":773094113280,"available":772851597312,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001743"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688426+0000","last_change":"2024-09-15T22:57:07.422481+0000","last_active":"2024-09-15T22:57:08.688426+0000","last_peered":"2024-09-15T22:57:08.688426+0000","last_clean":"2024-09-15T22:57:08.688426+0000","last_became_active":"2024-09-15T22:57:07.421724+0000","last_became_peered":"2024-09-15T22:57:07.421724+0000","last_unstale":"2024-09-15T22:57:08.688426+0000","last_undegraded":"2024-09-15T22:57:08.688426+0000","last_fullsized":"2024-09-15T22:57:08.688426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:05.395270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691428+0000","last_change":"2024-09-15T22:57:07.414811+0000","last_active":"2024-09-15T22:57:08.691428+0000","last_peered":"2024-09-15T22:57:08.691428+0000","last_clean":"2024-09-15T22:57:08.691428+0000","last_became_active":"2024-09-15T22:57:07.412780+0000","last_became_peered":"2024-09-15T22:57:07.412780+0000","last_unstale":"2024-09-15T22:57:08.691428+0000","last_undegraded":"2024-09-15T22:57:08.691428+0000","last_fullsized":"2024-09-15T22:57:08.691428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:34.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408209+0000","last_change":"2024-09-15T22:57:07.415251+0000","last_active":"2024-09-15T22:57:08.408209+0000","last_peered":"2024-09-15T22:57:08.408209+0000","last_clean":"2024-09-15T22:57:08.408209+0000","last_became_active":"2024-09-15T22:57:07.413708+0000","last_became_peered":"2024-09-15T22:57:07.413708+0000","last_unstale":"2024-09-15T22:57:08.408209+0000","last_undegraded":"2024-09-15T22:57:08.408209+0000","last_fullsized":"2024-09-15T22:57:08.408209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428567+0000","last_change":"2024-09-15T22:57:07.408039+0000","last_active":"2024-09-15T22:57:08.428567+0000","last_peered":"2024-09-15T22:57:08.428567+0000","last_clean":"2024-09-15T22:57:08.428567+0000","last_became_active":"2024-09-15T22:57:07.403618+0000","last_became_peered":"2024-09-15T22:57:07.403618+0000","last_unstale":"2024-09-15T22:57:08.428567+0000","last_undegraded":"2024-09-15T22:57:08.428567+0000","last_fullsized":"2024-09-15T22:57:08.428567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689773+0000","last_change":"2024-09-15T22:57:07.418137+0000","last_active":"2024-09-15T22:57:08.689773+0000","last_peered":"2024-09-15T22:57:08.689773+0000","last_clean":"2024-09-15T22:57:08.689773+0000","last_became_active":"2024-09-15T22:57:07.417768+0000","last_became_peered":"2024-09-15T22:57:07.417768+0000","last_unstale":"2024-09-15T22:57:08.689773+0000","last_undegraded":"2024-09-15T22:57:08.689773+0000","last_fullsized":"2024-09-15T22:57:08.689773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:40.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690489+0000","last_change":"2024-09-15T22:57:07.410791+0000","last_active":"2024-09-15T22:57:08.690489+0000","last_peered":"2024-09-15T22:57:08.690489+0000","last_clean":"2024-09-15T22:57:08.690489+0000","last_became_active":"2024-09-15T22:57:07.410385+0000","last_became_peered":"2024-09-15T22:57:07.410385+0000","last_unstale":"2024-09-15T22:57:08.690489+0000","last_undegraded":"2024-09-15T22:57:08.690489+0000","last_fullsized":"2024-09-15T22:57:08.690489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632493+0000","last_change":"2024-09-15T22:57:07.435315+0000","last_active":"2024-09-15T22:57:08.632493+0000","last_peered":"2024-09-15T22:57:08.632493+0000","last_clean":"2024-09-15T22:57:08.632493+0000","last_became_active":"2024-09-15T22:57:07.433936+0000","last_became_peered":"2024-09-15T22:57:07.433936+0000","last_unstale":"2024-09-15T22:57:08.632493+0000","last_undegraded":"2024-09-15T22:57:08.632493+0000","last_fullsized":"2024-09-15T22:57:08.632493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631705+0000","last_change":"2024-09-15T22:57:07.430306+0000","last_active":"2024-09-15T22:57:08.631705+0000","last_peered":"2024-09-15T22:57:08.631705+0000","last_clean":"2024-09-15T22:57:08.631705+0000","last_became_active":"2024-09-15T22:57:07.429327+0000","last_became_peered":"2024-09-15T22:57:07.429327+0000","last_unstale":"2024-09-15T22:57:08.631705+0000","last_undegraded":"2024-09-15T22:57:08.631705+0000","last_fullsized":"2024-09-15T22:57:08.631705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409967+0000","last_change":"2024-09-15T22:57:07.407409+0000","last_active":"2024-09-15T22:57:08.409967+0000","last_peered":"2024-09-15T22:57:08.409967+0000","last_clean":"2024-09-15T22:57:08.409967+0000","last_became_active":"2024-09-15T22:57:07.403239+0000","last_became_peered":"2024-09-15T22:57:07.403239+0000","last_unstale":"2024-09-15T22:57:08.409967+0000","last_undegraded":"2024-09-15T22:57:08.409967+0000","last_fullsized":"2024-09-15T22:57:08.409967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428974+0000","last_change":"2024-09-15T22:57:07.418481+0000","last_active":"2024-09-15T22:57:08.428974+0000","last_peered":"2024-09-15T22:57:08.428974+0000","last_clean":"2024-09-15T22:57:08.428974+0000","last_became_active":"2024-09-15T22:57:07.418179+0000","last_became_peered":"2024-09-15T22:57:07.418179+0000","last_unstale":"2024-09-15T22:57:08.428974+0000","last_undegraded":"2024-09-15T22:57:08.428974+0000","last_fullsized":"2024-09-15T22:57:08.428974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632496+0000","last_change":"2024-09-15T22:57:07.435002+0000","last_active":"2024-09-15T22:57:08.632496+0000","last_peered":"2024-09-15T22:57:08.632496+0000","last_clean":"2024-09-15T22:57:08.632496+0000","last_became_active":"2024-09-15T22:57:07.431791+0000","last_became_peered":"2024-09-15T22:57:07.431791+0000","last_unstale":"2024-09-15T22:57:08.632496+0000","last_undegraded":"2024-09-15T22:57:08.632496+0000","last_fullsized":"2024-09-15T22:57:08.632496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407709+0000","last_change":"2024-09-15T22:57:07.415567+0000","last_active":"2024-09-15T22:57:08.407709+0000","last_peered":"2024-09-15T22:57:08.407709+0000","last_clean":"2024-09-15T22:57:08.407709+0000","last_became_active":"2024-09-15T22:57:07.414859+0000","last_became_peered":"2024-09-15T22:57:07.414859+0000","last_unstale":"2024-09-15T22:57:08.407709+0000","last_undegraded":"2024-09-15T22:57:08.407709+0000","last_fullsized":"2024-09-15T22:57:08.407709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689796+0000","last_change":"2024-09-15T22:57:07.404912+0000","last_active":"2024-09-15T22:57:08.689796+0000","last_peered":"2024-09-15T22:57:08.689796+0000","last_clean":"2024-09-15T22:57:08.689796+0000","last_became_active":"2024-09-15T22:57:07.404646+0000","last_became_peered":"2024-09-15T22:57:07.404646+0000","last_unstale":"2024-09-15T22:57:08.689796+0000","last_undegraded":"2024-09-15T22:57:08.689796+0000","last_fullsized":"2024-09-15T22:57:08.689796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:59.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690626+0000","last_change":"2024-09-15T22:57:07.407611+0000","last_active":"2024-09-15T22:57:08.690626+0000","last_peered":"2024-09-15T22:57:08.690626+0000","last_clean":"2024-09-15T22:57:08.690626+0000","last_became_active":"2024-09-15T22:57:07.407094+0000","last_became_peered":"2024-09-15T22:57:07.407094+0000","last_unstale":"2024-09-15T22:57:08.690626+0000","last_undegraded":"2024-09-15T22:57:08.690626+0000","last_fullsized":"2024-09-15T22:57:08.690626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407468+0000","last_change":"2024-09-15T22:57:07.426899+0000","last_active":"2024-09-15T22:57:08.407468+0000","last_peered":"2024-09-15T22:57:08.407468+0000","last_clean":"2024-09-15T22:57:08.407468+0000","last_became_active":"2024-09-15T22:57:07.425429+0000","last_became_peered":"2024-09-15T22:57:07.425429+0000","last_unstale":"2024-09-15T22:57:08.407468+0000","last_undegraded":"2024-09-15T22:57:08.407468+0000","last_fullsized":"2024-09-15T22:57:08.407468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632524+0000","last_change":"2024-09-15T22:57:07.435259+0000","last_active":"2024-09-15T22:57:08.632524+0000","last_peered":"2024-09-15T22:57:08.632524+0000","last_clean":"2024-09-15T22:57:08.632524+0000","last_became_active":"2024-09-15T22:57:07.434672+0000","last_became_peered":"2024-09-15T22:57:07.434672+0000","last_unstale":"2024-09-15T22:57:08.632524+0000","last_undegraded":"2024-09-15T22:57:08.632524+0000","last_fullsized":"2024-09-15T22:57:08.632524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632732+0000","last_change":"2024-09-15T22:57:07.436431+0000","last_active":"2024-09-15T22:57:08.632732+0000","last_peered":"2024-09-15T22:57:08.632732+0000","last_clean":"2024-09-15T22:57:08.632732+0000","last_became_active":"2024-09-15T22:57:07.435624+0000","last_became_peered":"2024-09-15T22:57:07.435624+0000","last_unstale":"2024-09-15T22:57:08.632732+0000","last_undegraded":"2024-09-15T22:57:08.632732+0000","last_fullsized":"2024-09-15T22:57:08.632732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691316+0000","last_change":"2024-09-15T22:57:07.423612+0000","last_active":"2024-09-15T22:57:08.691316+0000","last_peered":"2024-09-15T22:57:08.691316+0000","last_clean":"2024-09-15T22:57:08.691316+0000","last_became_active":"2024-09-15T22:57:07.423279+0000","last_became_peered":"2024-09-15T22:57:07.423279+0000","last_unstale":"2024-09-15T22:57:08.691316+0000","last_undegraded":"2024-09-15T22:57:08.691316+0000","last_fullsized":"2024-09-15T22:57:08.691316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:18.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690687+0000","last_change":"2024-09-15T22:57:07.419227+0000","last_active":"2024-09-15T22:57:08.690687+0000","last_peered":"2024-09-15T22:57:08.690687+0000","last_clean":"2024-09-15T22:57:08.690687+0000","last_became_active":"2024-09-15T22:57:07.416882+0000","last_became_peered":"2024-09-15T22:57:07.416882+0000","last_unstale":"2024-09-15T22:57:08.690687+0000","last_undegraded":"2024-09-15T22:57:08.690687+0000","last_fullsized":"2024-09-15T22:57:08.690687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689823+0000","last_change":"2024-09-15T22:57:07.406087+0000","last_active":"2024-09-15T22:57:08.689823+0000","last_peered":"2024-09-15T22:57:08.689823+0000","last_clean":"2024-09-15T22:57:08.689823+0000","last_became_active":"2024-09-15T22:57:07.405688+0000","last_became_peered":"2024-09-15T22:57:07.405688+0000","last_unstale":"2024-09-15T22:57:08.689823+0000","last_undegraded":"2024-09-15T22:57:08.689823+0000","last_fullsized":"2024-09-15T22:57:08.689823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:32.357178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409112+0000","last_change":"2024-09-15T22:57:07.425157+0000","last_active":"2024-09-15T22:57:08.409112+0000","last_peered":"2024-09-15T22:57:08.409112+0000","last_clean":"2024-09-15T22:57:08.409112+0000","last_became_active":"2024-09-15T22:57:07.424459+0000","last_became_peered":"2024-09-15T22:57:07.424459+0000","last_unstale":"2024-09-15T22:57:08.409112+0000","last_undegraded":"2024-09-15T22:57:08.409112+0000","last_fullsized":"2024-09-15T22:57:08.409112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409214+0000","last_change":"2024-09-15T22:57:07.419020+0000","last_active":"2024-09-15T22:57:08.409214+0000","last_peered":"2024-09-15T22:57:08.409214+0000","last_clean":"2024-09-15T22:57:08.409214+0000","last_became_active":"2024-09-15T22:57:07.418272+0000","last_became_peered":"2024-09-15T22:57:07.418272+0000","last_unstale":"2024-09-15T22:57:08.409214+0000","last_undegraded":"2024-09-15T22:57:08.409214+0000","last_fullsized":"2024-09-15T22:57:08.409214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.405815+0000","last_change":"2024-09-15T22:57:07.414552+0000","last_active":"2024-09-15T22:57:08.405815+0000","last_peered":"2024-09-15T22:57:08.405815+0000","last_clean":"2024-09-15T22:57:08.405815+0000","last_became_active":"2024-09-15T22:57:07.414153+0000","last_became_peered":"2024-09-15T22:57:07.414153+0000","last_unstale":"2024-09-15T22:57:08.405815+0000","last_undegraded":"2024-09-15T22:57:08.405815+0000","last_fullsized":"2024-09-15T22:57:08.405815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:58.690688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406902+0000","last_change":"2024-09-15T22:57:07.407145+0000","last_active":"2024-09-15T22:57:08.406902+0000","last_peered":"2024-09-15T22:57:08.406902+0000","last_clean":"2024-09-15T22:57:08.406902+0000","last_became_active":"2024-09-15T22:57:07.406323+0000","last_became_peered":"2024-09-15T22:57:07.406323+0000","last_unstale":"2024-09-15T22:57:08.406902+0000","last_undegraded":"2024-09-15T22:57:08.406902+0000","last_fullsized":"2024-09-15T22:57:08.406902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429032+0000","last_change":"2024-09-15T22:57:07.438561+0000","last_active":"2024-09-15T22:57:08.429032+0000","last_peered":"2024-09-15T22:57:08.429032+0000","last_clean":"2024-09-15T22:57:08.429032+0000","last_became_active":"2024-09-15T22:57:07.438342+0000","last_became_peered":"2024-09-15T22:57:07.438342+0000","last_unstale":"2024-09-15T22:57:08.429032+0000","last_undegraded":"2024-09-15T22:57:08.429032+0000","last_fullsized":"2024-09-15T22:57:08.429032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691548+0000","last_change":"2024-09-15T22:57:07.414994+0000","last_active":"2024-09-15T22:57:08.691548+0000","last_peered":"2024-09-15T22:57:08.691548+0000","last_clean":"2024-09-15T22:57:08.691548+0000","last_became_active":"2024-09-15T22:57:07.414712+0000","last_became_peered":"2024-09-15T22:57:07.414712+0000","last_unstale":"2024-09-15T22:57:08.691548+0000","last_undegraded":"2024-09-15T22:57:08.691548+0000","last_fullsized":"2024-09-15T22:57:08.691548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:12.113967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429009+0000","last_change":"2024-09-15T22:57:07.413192+0000","last_active":"2024-09-15T22:57:08.429009+0000","last_peered":"2024-09-15T22:57:08.429009+0000","last_clean":"2024-09-15T22:57:08.429009+0000","last_became_active":"2024-09-15T22:57:07.411535+0000","last_became_peered":"2024-09-15T22:57:07.411535+0000","last_unstale":"2024-09-15T22:57:08.429009+0000","last_undegraded":"2024-09-15T22:57:08.429009+0000","last_fullsized":"2024-09-15T22:57:08.429009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407855+0000","last_change":"2024-09-15T22:57:07.396994+0000","last_active":"2024-09-15T22:57:08.407855+0000","last_peered":"2024-09-15T22:57:08.407855+0000","last_clean":"2024-09-15T22:57:08.407855+0000","last_became_active":"2024-09-15T22:57:07.395762+0000","last_became_peered":"2024-09-15T22:57:07.395762+0000","last_unstale":"2024-09-15T22:57:08.407855+0000","last_undegraded":"2024-09-15T22:57:08.407855+0000","last_fullsized":"2024-09-15T22:57:08.407855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409839+0000","last_change":"2024-09-15T22:57:07.419508+0000","last_active":"2024-09-15T22:57:08.409839+0000","last_peered":"2024-09-15T22:57:08.409839+0000","last_clean":"2024-09-15T22:57:08.409839+0000","last_became_active":"2024-09-15T22:57:07.418717+0000","last_became_peered":"2024-09-15T22:57:07.418717+0000","last_unstale":"2024-09-15T22:57:08.409839+0000","last_undegraded":"2024-09-15T22:57:08.409839+0000","last_fullsized":"2024-09-15T22:57:08.409839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631996+0000","last_change":"2024-09-15T22:57:07.434428+0000","last_active":"2024-09-15T22:57:08.631996+0000","last_peered":"2024-09-15T22:57:08.631996+0000","last_clean":"2024-09-15T22:57:08.631996+0000","last_became_active":"2024-09-15T22:57:07.433439+0000","last_became_peered":"2024-09-15T22:57:07.433439+0000","last_unstale":"2024-09-15T22:57:08.631996+0000","last_undegraded":"2024-09-15T22:57:08.631996+0000","last_fullsized":"2024-09-15T22:57:08.631996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688154+0000","last_change":"2024-09-15T22:57:07.422941+0000","last_active":"2024-09-15T22:57:08.688154+0000","last_peered":"2024-09-15T22:57:08.688154+0000","last_clean":"2024-09-15T22:57:08.688154+0000","last_became_active":"2024-09-15T22:57:07.422106+0000","last_became_peered":"2024-09-15T22:57:07.422106+0000","last_unstale":"2024-09-15T22:57:08.688154+0000","last_undegraded":"2024-09-15T22:57:08.688154+0000","last_fullsized":"2024-09-15T22:57:08.688154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.004375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631605+0000","last_change":"2024-09-15T22:57:07.434147+0000","last_active":"2024-09-15T22:57:08.631605+0000","last_peered":"2024-09-15T22:57:08.631605+0000","last_clean":"2024-09-15T22:57:08.631605+0000","last_became_active":"2024-09-15T22:57:07.433483+0000","last_became_peered":"2024-09-15T22:57:07.433483+0000","last_unstale":"2024-09-15T22:57:08.631605+0000","last_undegraded":"2024-09-15T22:57:08.631605+0000","last_fullsized":"2024-09-15T22:57:08.631605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406724+0000","last_change":"2024-09-15T22:57:07.431680+0000","last_active":"2024-09-15T22:57:08.406724+0000","last_peered":"2024-09-15T22:57:08.406724+0000","last_clean":"2024-09-15T22:57:08.406724+0000","last_became_active":"2024-09-15T22:57:07.431296+0000","last_became_peered":"2024-09-15T22:57:07.431296+0000","last_unstale":"2024-09-15T22:57:08.406724+0000","last_undegraded":"2024-09-15T22:57:08.406724+0000","last_fullsized":"2024-09-15T22:57:08.406724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688577+0000","last_change":"2024-09-15T22:57:06.414917+0000","last_active":"2024-09-15T22:57:08.688577+0000","last_peered":"2024-09-15T22:57:08.688577+0000","last_clean":"2024-09-15T22:57:08.688577+0000","last_became_active":"2024-09-15T22:57:06.414118+0000","last_became_peered":"2024-09-15T22:57:06.414118+0000","last_unstale":"2024-09-15T22:57:08.688577+0000","last_undegraded":"2024-09-15T22:57:08.688577+0000","last_fullsized":"2024-09-15T22:57:08.688577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688437+0000","last_change":"2024-09-15T22:57:07.409723+0000","last_active":"2024-09-15T22:57:08.688437+0000","last_peered":"2024-09-15T22:57:08.688437+0000","last_clean":"2024-09-15T22:57:08.688437+0000","last_became_active":"2024-09-15T22:57:07.409014+0000","last_became_peered":"2024-09-15T22:57:07.409014+0000","last_unstale":"2024-09-15T22:57:08.688437+0000","last_undegraded":"2024-09-15T22:57:08.688437+0000","last_fullsized":"2024-09-15T22:57:08.688437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:17.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406444+0000","last_change":"2024-09-15T22:57:06.412023+0000","last_active":"2024-09-15T22:57:08.406444+0000","last_peered":"2024-09-15T22:57:08.406444+0000","last_clean":"2024-09-15T22:57:08.406444+0000","last_became_active":"2024-09-15T22:57:06.411659+0000","last_became_peered":"2024-09-15T22:57:06.411659+0000","last_unstale":"2024-09-15T22:57:08.406444+0000","last_undegraded":"2024-09-15T22:57:08.406444+0000","last_fullsized":"2024-09-15T22:57:08.406444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409494+0000","last_change":"2024-09-15T22:57:07.423198+0000","last_active":"2024-09-15T22:57:08.409494+0000","last_peered":"2024-09-15T22:57:08.409494+0000","last_clean":"2024-09-15T22:57:08.409494+0000","last_became_active":"2024-09-15T22:57:07.422471+0000","last_became_peered":"2024-09-15T22:57:07.422471+0000","last_unstale":"2024-09-15T22:57:08.409494+0000","last_undegraded":"2024-09-15T22:57:08.409494+0000","last_fullsized":"2024-09-15T22:57:08.409494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691206+0000","last_change":"2024-09-15T22:57:06.396932+0000","last_active":"2024-09-15T22:57:08.691206+0000","last_peered":"2024-09-15T22:57:08.691206+0000","last_clean":"2024-09-15T22:57:08.691206+0000","last_became_active":"2024-09-15T22:57:06.396128+0000","last_became_peered":"2024-09-15T22:57:06.396128+0000","last_unstale":"2024-09-15T22:57:08.691206+0000","last_undegraded":"2024-09-15T22:57:08.691206+0000","last_fullsized":"2024-09-15T22:57:08.691206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:50.738771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429291+0000","last_change":"2024-09-15T22:57:07.413424+0000","last_active":"2024-09-15T22:57:08.429291+0000","last_peered":"2024-09-15T22:57:08.429291+0000","last_clean":"2024-09-15T22:57:08.429291+0000","last_became_active":"2024-09-15T22:57:07.411914+0000","last_became_peered":"2024-09-15T22:57:07.411914+0000","last_unstale":"2024-09-15T22:57:08.429291+0000","last_undegraded":"2024-09-15T22:57:08.429291+0000","last_fullsized":"2024-09-15T22:57:08.429291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689719+0000","last_change":"2024-09-15T22:57:06.389724+0000","last_active":"2024-09-15T22:57:08.689719+0000","last_peered":"2024-09-15T22:57:08.689719+0000","last_clean":"2024-09-15T22:57:08.689719+0000","last_became_active":"2024-09-15T22:57:06.389420+0000","last_became_peered":"2024-09-15T22:57:06.389420+0000","last_unstale":"2024-09-15T22:57:08.689719+0000","last_undegraded":"2024-09-15T22:57:08.689719+0000","last_fullsized":"2024-09-15T22:57:08.689719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:16.912850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632632+0000","last_change":"2024-09-15T22:57:07.434140+0000","last_active":"2024-09-15T22:57:08.632632+0000","last_peered":"2024-09-15T22:57:08.632632+0000","last_clean":"2024-09-15T22:57:08.632632+0000","last_became_active":"2024-09-15T22:57:07.432682+0000","last_became_peered":"2024-09-15T22:57:07.432682+0000","last_unstale":"2024-09-15T22:57:08.632632+0000","last_undegraded":"2024-09-15T22:57:08.632632+0000","last_fullsized":"2024-09-15T22:57:08.632632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409387+0000","last_change":"2024-09-15T22:57:06.406695+0000","last_active":"2024-09-15T22:57:08.409387+0000","last_peered":"2024-09-15T22:57:08.409387+0000","last_clean":"2024-09-15T22:57:08.409387+0000","last_became_active":"2024-09-15T22:57:06.405989+0000","last_became_peered":"2024-09-15T22:57:06.405989+0000","last_unstale":"2024-09-15T22:57:08.409387+0000","last_undegraded":"2024-09-15T22:57:08.409387+0000","last_fullsized":"2024-09-15T22:57:08.409387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407859+0000","last_change":"2024-09-15T22:57:07.415274+0000","last_active":"2024-09-15T22:57:08.407859+0000","last_peered":"2024-09-15T22:57:08.407859+0000","last_clean":"2024-09-15T22:57:08.407859+0000","last_became_active":"2024-09-15T22:57:07.414432+0000","last_became_peered":"2024-09-15T22:57:07.414432+0000","last_unstale":"2024-09-15T22:57:08.407859+0000","last_undegraded":"2024-09-15T22:57:08.407859+0000","last_fullsized":"2024-09-15T22:57:08.407859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409468+0000","last_change":"2024-09-15T22:57:06.406784+0000","last_active":"2024-09-15T22:57:08.409468+0000","last_peered":"2024-09-15T22:57:08.409468+0000","last_clean":"2024-09-15T22:57:08.409468+0000","last_became_active":"2024-09-15T22:57:06.406044+0000","last_became_peered":"2024-09-15T22:57:06.406044+0000","last_unstale":"2024-09-15T22:57:08.409468+0000","last_undegraded":"2024-09-15T22:57:08.409468+0000","last_fullsized":"2024-09-15T22:57:08.409468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:11.807980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407829+0000","last_change":"2024-09-15T22:57:07.426916+0000","last_active":"2024-09-15T22:57:08.407829+0000","last_peered":"2024-09-15T22:57:08.407829+0000","last_clean":"2024-09-15T22:57:08.407829+0000","last_became_active":"2024-09-15T22:57:07.426135+0000","last_became_peered":"2024-09-15T22:57:07.426135+0000","last_unstale":"2024-09-15T22:57:08.407829+0000","last_undegraded":"2024-09-15T22:57:08.407829+0000","last_fullsized":"2024-09-15T22:57:08.407829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688768+0000","last_change":"2024-09-15T22:57:06.396319+0000","last_active":"2024-09-15T22:57:08.688768+0000","last_peered":"2024-09-15T22:57:08.688768+0000","last_clean":"2024-09-15T22:57:08.688768+0000","last_became_active":"2024-09-15T22:57:06.395943+0000","last_became_peered":"2024-09-15T22:57:06.395943+0000","last_unstale":"2024-09-15T22:57:08.688768+0000","last_undegraded":"2024-09-15T22:57:08.688768+0000","last_fullsized":"2024-09-15T22:57:08.688768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428210+0000","last_change":"2024-09-15T22:57:07.427285+0000","last_active":"2024-09-15T22:57:08.428210+0000","last_peered":"2024-09-15T22:57:08.428210+0000","last_clean":"2024-09-15T22:57:08.428210+0000","last_became_active":"2024-09-15T22:57:07.426924+0000","last_became_peered":"2024-09-15T22:57:07.426924+0000","last_unstale":"2024-09-15T22:57:08.428210+0000","last_undegraded":"2024-09-15T22:57:08.428210+0000","last_fullsized":"2024-09-15T22:57:08.428210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408072+0000","last_change":"2024-09-15T22:57:06.403648+0000","last_active":"2024-09-15T22:57:08.408072+0000","last_peered":"2024-09-15T22:57:08.408072+0000","last_clean":"2024-09-15T22:57:08.408072+0000","last_became_active":"2024-09-15T22:57:06.402925+0000","last_became_peered":"2024-09-15T22:57:06.402925+0000","last_unstale":"2024-09-15T22:57:08.408072+0000","last_undegraded":"2024-09-15T22:57:08.408072+0000","last_fullsized":"2024-09-15T22:57:08.408072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408608+0000","last_change":"2024-09-15T22:57:07.408441+0000","last_active":"2024-09-15T22:57:08.408608+0000","last_peered":"2024-09-15T22:57:08.408608+0000","last_clean":"2024-09-15T22:57:08.408608+0000","last_became_active":"2024-09-15T22:57:07.407246+0000","last_became_peered":"2024-09-15T22:57:07.407246+0000","last_unstale":"2024-09-15T22:57:08.408608+0000","last_undegraded":"2024-09-15T22:57:08.408608+0000","last_fullsized":"2024-09-15T22:57:08.408608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691475+0000","last_change":"2024-09-15T22:57:06.415706+0000","last_active":"2024-09-15T22:57:08.691475+0000","last_peered":"2024-09-15T22:57:08.691475+0000","last_clean":"2024-09-15T22:57:08.691475+0000","last_became_active":"2024-09-15T22:57:06.415352+0000","last_became_peered":"2024-09-15T22:57:06.415352+0000","last_unstale":"2024-09-15T22:57:08.691475+0000","last_undegraded":"2024-09-15T22:57:08.691475+0000","last_fullsized":"2024-09-15T22:57:08.691475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:57.681781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691271+0000","last_change":"2024-09-15T22:57:07.420932+0000","last_active":"2024-09-15T22:57:08.691271+0000","last_peered":"2024-09-15T22:57:08.691271+0000","last_clean":"2024-09-15T22:57:08.691271+0000","last_became_active":"2024-09-15T22:57:07.420671+0000","last_became_peered":"2024-09-15T22:57:07.420671+0000","last_unstale":"2024-09-15T22:57:08.691271+0000","last_undegraded":"2024-09-15T22:57:08.691271+0000","last_fullsized":"2024-09-15T22:57:08.691271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406614+0000","last_change":"2024-09-15T22:57:06.399559+0000","last_active":"2024-09-15T22:57:08.406614+0000","last_peered":"2024-09-15T22:57:08.406614+0000","last_clean":"2024-09-15T22:57:08.406614+0000","last_became_active":"2024-09-15T22:57:06.399192+0000","last_became_peered":"2024-09-15T22:57:06.399192+0000","last_unstale":"2024-09-15T22:57:08.406614+0000","last_undegraded":"2024-09-15T22:57:08.406614+0000","last_fullsized":"2024-09-15T22:57:08.406614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690967+0000","last_change":"2024-09-15T22:57:07.415974+0000","last_active":"2024-09-15T22:57:08.690967+0000","last_peered":"2024-09-15T22:57:08.690967+0000","last_clean":"2024-09-15T22:57:08.690967+0000","last_became_active":"2024-09-15T22:57:07.415666+0000","last_became_peered":"2024-09-15T22:57:07.415666+0000","last_unstale":"2024-09-15T22:57:08.690967+0000","last_undegraded":"2024-09-15T22:57:08.690967+0000","last_fullsized":"2024-09-15T22:57:08.690967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408478+0000","last_change":"2024-09-15T22:57:06.416238+0000","last_active":"2024-09-15T22:57:08.408478+0000","last_peered":"2024-09-15T22:57:08.408478+0000","last_clean":"2024-09-15T22:57:08.408478+0000","last_became_active":"2024-09-15T22:57:06.415550+0000","last_became_peered":"2024-09-15T22:57:06.415550+0000","last_unstale":"2024-09-15T22:57:08.408478+0000","last_undegraded":"2024-09-15T22:57:08.408478+0000","last_fullsized":"2024-09-15T22:57:08.408478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407783+0000","last_change":"2024-09-15T22:57:07.415886+0000","last_active":"2024-09-15T22:57:08.407783+0000","last_peered":"2024-09-15T22:57:08.407783+0000","last_clean":"2024-09-15T22:57:08.407783+0000","last_became_active":"2024-09-15T22:57:07.414584+0000","last_became_peered":"2024-09-15T22:57:07.414584+0000","last_unstale":"2024-09-15T22:57:08.407783+0000","last_undegraded":"2024-09-15T22:57:08.407783+0000","last_fullsized":"2024-09-15T22:57:08.407783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691493+0000","last_change":"2024-09-15T22:57:06.397779+0000","last_active":"2024-09-15T22:57:08.691493+0000","last_peered":"2024-09-15T22:57:08.691493+0000","last_clean":"2024-09-15T22:57:08.691493+0000","last_became_active":"2024-09-15T22:57:06.396940+0000","last_became_peered":"2024-09-15T22:57:06.396940+0000","last_unstale":"2024-09-15T22:57:08.691493+0000","last_undegraded":"2024-09-15T22:57:08.691493+0000","last_fullsized":"2024-09-15T22:57:08.691493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428477+0000","last_change":"2024-09-15T22:57:07.427292+0000","last_active":"2024-09-15T22:57:08.428477+0000","last_peered":"2024-09-15T22:57:08.428477+0000","last_clean":"2024-09-15T22:57:08.428477+0000","last_became_active":"2024-09-15T22:57:07.426935+0000","last_became_peered":"2024-09-15T22:57:07.426935+0000","last_unstale":"2024-09-15T22:57:08.428477+0000","last_undegraded":"2024-09-15T22:57:08.428477+0000","last_fullsized":"2024-09-15T22:57:08.428477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409673+0000","last_change":"2024-09-15T22:57:06.419004+0000","last_active":"2024-09-15T22:57:08.409673+0000","last_peered":"2024-09-15T22:57:08.409673+0000","last_clean":"2024-09-15T22:57:08.409673+0000","last_became_active":"2024-09-15T22:57:06.418305+0000","last_became_peered":"2024-09-15T22:57:06.418305+0000","last_unstale":"2024-09-15T22:57:08.409673+0000","last_undegraded":"2024-09-15T22:57:08.409673+0000","last_fullsized":"2024-09-15T22:57:08.409673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690853+0000","last_change":"2024-09-15T22:57:07.420047+0000","last_active":"2024-09-15T22:57:08.690853+0000","last_peered":"2024-09-15T22:57:08.690853+0000","last_clean":"2024-09-15T22:57:08.690853+0000","last_became_active":"2024-09-15T22:57:07.419680+0000","last_became_peered":"2024-09-15T22:57:07.419680+0000","last_unstale":"2024-09-15T22:57:08.690853+0000","last_undegraded":"2024-09-15T22:57:08.690853+0000","last_fullsized":"2024-09-15T22:57:08.690853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428388+0000","last_change":"2024-09-15T22:57:06.397650+0000","last_active":"2024-09-15T22:57:08.428388+0000","last_peered":"2024-09-15T22:57:08.428388+0000","last_clean":"2024-09-15T22:57:08.428388+0000","last_became_active":"2024-09-15T22:57:06.397149+0000","last_became_peered":"2024-09-15T22:57:06.397149+0000","last_unstale":"2024-09-15T22:57:08.428388+0000","last_undegraded":"2024-09-15T22:57:08.428388+0000","last_fullsized":"2024-09-15T22:57:08.428388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632659+0000","last_change":"2024-09-15T22:57:07.434274+0000","last_active":"2024-09-15T22:57:08.632659+0000","last_peered":"2024-09-15T22:57:08.632659+0000","last_clean":"2024-09-15T22:57:08.632659+0000","last_became_active":"2024-09-15T22:57:07.433581+0000","last_became_peered":"2024-09-15T22:57:07.433581+0000","last_unstale":"2024-09-15T22:57:08.632659+0000","last_undegraded":"2024-09-15T22:57:08.632659+0000","last_fullsized":"2024-09-15T22:57:08.632659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690091+0000","last_change":"2024-09-15T22:57:06.414226+0000","last_active":"2024-09-15T22:57:08.690091+0000","last_peered":"2024-09-15T22:57:08.690091+0000","last_clean":"2024-09-15T22:57:08.690091+0000","last_became_active":"2024-09-15T22:57:06.413884+0000","last_became_peered":"2024-09-15T22:57:06.413884+0000","last_unstale":"2024-09-15T22:57:08.690091+0000","last_undegraded":"2024-09-15T22:57:08.690091+0000","last_fullsized":"2024-09-15T22:57:08.690091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.541726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688260+0000","last_change":"2024-09-15T22:57:07.410462+0000","last_active":"2024-09-15T22:57:08.688260+0000","last_peered":"2024-09-15T22:57:08.688260+0000","last_clean":"2024-09-15T22:57:08.688260+0000","last_became_active":"2024-09-15T22:57:07.409146+0000","last_became_peered":"2024-09-15T22:57:07.409146+0000","last_unstale":"2024-09-15T22:57:08.688260+0000","last_undegraded":"2024-09-15T22:57:08.688260+0000","last_fullsized":"2024-09-15T22:57:08.688260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.835015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688862+0000","last_change":"2024-09-15T22:57:06.396109+0000","last_active":"2024-09-15T22:57:08.688862+0000","last_peered":"2024-09-15T22:57:08.688862+0000","last_clean":"2024-09-15T22:57:08.688862+0000","last_became_active":"2024-09-15T22:57:06.395817+0000","last_became_peered":"2024-09-15T22:57:06.395817+0000","last_unstale":"2024-09-15T22:57:08.688862+0000","last_undegraded":"2024-09-15T22:57:08.688862+0000","last_fullsized":"2024-09-15T22:57:08.688862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:16.048300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409208+0000","last_change":"2024-09-15T22:57:07.402992+0000","last_active":"2024-09-15T22:57:08.409208+0000","last_peered":"2024-09-15T22:57:08.409208+0000","last_clean":"2024-09-15T22:57:08.409208+0000","last_became_active":"2024-09-15T22:57:07.402275+0000","last_became_peered":"2024-09-15T22:57:07.402275+0000","last_unstale":"2024-09-15T22:57:08.409208+0000","last_undegraded":"2024-09-15T22:57:08.409208+0000","last_fullsized":"2024-09-15T22:57:08.409208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429096+0000","last_change":"2024-09-15T22:57:06.399079+0000","last_active":"2024-09-15T22:57:08.429096+0000","last_peered":"2024-09-15T22:57:08.429096+0000","last_clean":"2024-09-15T22:57:08.429096+0000","last_became_active":"2024-09-15T22:57:06.398592+0000","last_became_peered":"2024-09-15T22:57:06.398592+0000","last_unstale":"2024-09-15T22:57:08.429096+0000","last_undegraded":"2024-09-15T22:57:08.429096+0000","last_fullsized":"2024-09-15T22:57:08.429096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408814+0000","last_change":"2024-09-15T22:57:07.392962+0000","last_active":"2024-09-15T22:57:08.408814+0000","last_peered":"2024-09-15T22:57:08.408814+0000","last_clean":"2024-09-15T22:57:08.408814+0000","last_became_active":"2024-09-15T22:57:07.392136+0000","last_became_peered":"2024-09-15T22:57:07.392136+0000","last_unstale":"2024-09-15T22:57:08.408814+0000","last_undegraded":"2024-09-15T22:57:08.408814+0000","last_fullsized":"2024-09-15T22:57:08.408814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409439+0000","last_change":"2024-09-15T22:57:06.403454+0000","last_active":"2024-09-15T22:57:08.409439+0000","last_peered":"2024-09-15T22:57:08.409439+0000","last_clean":"2024-09-15T22:57:08.409439+0000","last_became_active":"2024-09-15T22:57:06.402754+0000","last_became_peered":"2024-09-15T22:57:06.402754+0000","last_unstale":"2024-09-15T22:57:08.409439+0000","last_undegraded":"2024-09-15T22:57:08.409439+0000","last_fullsized":"2024-09-15T22:57:08.409439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428445+0000","last_change":"2024-09-15T22:57:07.416567+0000","last_active":"2024-09-15T22:57:08.428445+0000","last_peered":"2024-09-15T22:57:08.428445+0000","last_clean":"2024-09-15T22:57:08.428445+0000","last_became_active":"2024-09-15T22:57:07.416211+0000","last_became_peered":"2024-09-15T22:57:07.416211+0000","last_unstale":"2024-09-15T22:57:08.428445+0000","last_undegraded":"2024-09-15T22:57:08.428445+0000","last_fullsized":"2024-09-15T22:57:08.428445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409205+0000","last_change":"2024-09-15T22:57:06.392051+0000","last_active":"2024-09-15T22:57:08.409205+0000","last_peered":"2024-09-15T22:57:08.409205+0000","last_clean":"2024-09-15T22:57:08.409205+0000","last_became_active":"2024-09-15T22:57:06.391291+0000","last_became_peered":"2024-09-15T22:57:06.391291+0000","last_unstale":"2024-09-15T22:57:08.409205+0000","last_undegraded":"2024-09-15T22:57:08.409205+0000","last_fullsized":"2024-09-15T22:57:08.409205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689677+0000","last_change":"2024-09-15T22:57:07.404167+0000","last_active":"2024-09-15T22:57:08.689677+0000","last_peered":"2024-09-15T22:57:08.689677+0000","last_clean":"2024-09-15T22:57:08.689677+0000","last_became_active":"2024-09-15T22:57:07.403777+0000","last_became_peered":"2024-09-15T22:57:07.403777+0000","last_unstale":"2024-09-15T22:57:08.689677+0000","last_undegraded":"2024-09-15T22:57:08.689677+0000","last_fullsized":"2024-09-15T22:57:08.689677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:48.121142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409721+0000","last_change":"2024-09-15T22:57:06.401089+0000","last_active":"2024-09-15T22:57:08.409721+0000","last_peered":"2024-09-15T22:57:08.409721+0000","last_clean":"2024-09-15T22:57:08.409721+0000","last_became_active":"2024-09-15T22:57:06.394169+0000","last_became_peered":"2024-09-15T22:57:06.394169+0000","last_unstale":"2024-09-15T22:57:08.409721+0000","last_undegraded":"2024-09-15T22:57:08.409721+0000","last_fullsized":"2024-09-15T22:57:08.409721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689807+0000","last_change":"2024-09-15T22:57:07.402811+0000","last_active":"2024-09-15T22:57:08.689807+0000","last_peered":"2024-09-15T22:57:08.689807+0000","last_clean":"2024-09-15T22:57:08.689807+0000","last_became_active":"2024-09-15T22:57:07.401817+0000","last_became_peered":"2024-09-15T22:57:07.401817+0000","last_unstale":"2024-09-15T22:57:08.689807+0000","last_undegraded":"2024-09-15T22:57:08.689807+0000","last_fullsized":"2024-09-15T22:57:08.689807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:15.684506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406524+0000","last_change":"2024-09-15T22:57:06.391113+0000","last_active":"2024-09-15T22:57:08.406524+0000","last_peered":"2024-09-15T22:57:08.406524+0000","last_clean":"2024-09-15T22:57:08.406524+0000","last_became_active":"2024-09-15T22:57:06.390708+0000","last_became_peered":"2024-09-15T22:57:06.390708+0000","last_unstale":"2024-09-15T22:57:08.406524+0000","last_undegraded":"2024-09-15T22:57:08.406524+0000","last_fullsized":"2024-09-15T22:57:08.406524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690203+0000","last_change":"2024-09-15T22:57:07.415492+0000","last_active":"2024-09-15T22:57:08.690203+0000","last_peered":"2024-09-15T22:57:08.690203+0000","last_clean":"2024-09-15T22:57:08.690203+0000","last_became_active":"2024-09-15T22:57:07.415101+0000","last_became_peered":"2024-09-15T22:57:07.415101+0000","last_unstale":"2024-09-15T22:57:08.690203+0000","last_undegraded":"2024-09-15T22:57:08.690203+0000","last_fullsized":"2024-09-15T22:57:08.690203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:12.051194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688138+0000","last_change":"2024-09-15T22:57:06.410239+0000","last_active":"2024-09-15T22:57:08.688138+0000","last_peered":"2024-09-15T22:57:08.688138+0000","last_clean":"2024-09-15T22:57:08.688138+0000","last_became_active":"2024-09-15T22:57:06.408665+0000","last_became_peered":"2024-09-15T22:57:06.408665+0000","last_unstale":"2024-09-15T22:57:08.688138+0000","last_undegraded":"2024-09-15T22:57:08.688138+0000","last_fullsized":"2024-09-15T22:57:08.688138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689271+0000","last_change":"2024-09-15T22:57:07.412078+0000","last_active":"2024-09-15T22:57:08.689271+0000","last_peered":"2024-09-15T22:57:08.689271+0000","last_clean":"2024-09-15T22:57:08.689271+0000","last_became_active":"2024-09-15T22:57:07.411701+0000","last_became_peered":"2024-09-15T22:57:07.411701+0000","last_unstale":"2024-09-15T22:57:08.689271+0000","last_undegraded":"2024-09-15T22:57:08.689271+0000","last_fullsized":"2024-09-15T22:57:08.689271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:15.244770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.410091+0000","last_change":"2024-09-15T22:57:06.399953+0000","last_active":"2024-09-15T22:57:08.410091+0000","last_peered":"2024-09-15T22:57:08.410091+0000","last_clean":"2024-09-15T22:57:08.410091+0000","last_became_active":"2024-09-15T22:57:06.398273+0000","last_became_peered":"2024-09-15T22:57:06.398273+0000","last_unstale":"2024-09-15T22:57:08.410091+0000","last_undegraded":"2024-09-15T22:57:08.410091+0000","last_fullsized":"2024-09-15T22:57:08.410091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:14.235863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631880+0000","last_change":"2024-09-15T22:57:07.434347+0000","last_active":"2024-09-15T22:57:08.631880+0000","last_peered":"2024-09-15T22:57:08.631880+0000","last_clean":"2024-09-15T22:57:08.631880+0000","last_became_active":"2024-09-15T22:57:07.433210+0000","last_became_peered":"2024-09-15T22:57:07.433210+0000","last_unstale":"2024-09-15T22:57:08.631880+0000","last_undegraded":"2024-09-15T22:57:08.631880+0000","last_fullsized":"2024-09-15T22:57:08.631880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407147+0000","last_change":"2024-09-15T22:57:06.416531+0000","last_active":"2024-09-15T22:57:08.407147+0000","last_peered":"2024-09-15T22:57:08.407147+0000","last_clean":"2024-09-15T22:57:08.407147+0000","last_became_active":"2024-09-15T22:57:06.415794+0000","last_became_peered":"2024-09-15T22:57:06.415794+0000","last_unstale":"2024-09-15T22:57:08.407147+0000","last_undegraded":"2024-09-15T22:57:08.407147+0000","last_fullsized":"2024-09-15T22:57:08.407147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689263+0000","last_change":"2024-09-15T22:57:07.404294+0000","last_active":"2024-09-15T22:57:08.689263+0000","last_peered":"2024-09-15T22:57:08.689263+0000","last_clean":"2024-09-15T22:57:08.689263+0000","last_became_active":"2024-09-15T22:57:07.403987+0000","last_became_peered":"2024-09-15T22:57:07.403987+0000","last_unstale":"2024-09-15T22:57:08.689263+0000","last_undegraded":"2024-09-15T22:57:08.689263+0000","last_fullsized":"2024-09-15T22:57:08.689263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:12.816887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429123+0000","last_change":"2024-09-15T22:57:06.409400+0000","last_active":"2024-09-15T22:57:08.429123+0000","last_peered":"2024-09-15T22:57:08.429123+0000","last_clean":"2024-09-15T22:57:08.429123+0000","last_became_active":"2024-09-15T22:57:06.409087+0000","last_became_peered":"2024-09-15T22:57:06.409087+0000","last_unstale":"2024-09-15T22:57:08.429123+0000","last_undegraded":"2024-09-15T22:57:08.429123+0000","last_fullsized":"2024-09-15T22:57:08.429123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409189+0000","last_change":"2024-09-15T22:57:07.412280+0000","last_active":"2024-09-15T22:57:08.409189+0000","last_peered":"2024-09-15T22:57:08.409189+0000","last_clean":"2024-09-15T22:57:08.409189+0000","last_became_active":"2024-09-15T22:57:07.410996+0000","last_became_peered":"2024-09-15T22:57:07.410996+0000","last_unstale":"2024-09-15T22:57:08.409189+0000","last_undegraded":"2024-09-15T22:57:08.409189+0000","last_fullsized":"2024-09-15T22:57:08.409189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.426761+0000","last_change":"2024-09-15T22:57:06.392231+0000","last_active":"2024-09-15T22:57:08.426761+0000","last_peered":"2024-09-15T22:57:08.426761+0000","last_clean":"2024-09-15T22:57:08.426761+0000","last_became_active":"2024-09-15T22:57:06.391825+0000","last_became_peered":"2024-09-15T22:57:06.391825+0000","last_unstale":"2024-09-15T22:57:08.426761+0000","last_undegraded":"2024-09-15T22:57:08.426761+0000","last_fullsized":"2024-09-15T22:57:08.426761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:39.096197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406616+0000","last_change":"2024-09-15T22:57:07.419511+0000","last_active":"2024-09-15T22:57:08.406616+0000","last_peered":"2024-09-15T22:57:08.406616+0000","last_clean":"2024-09-15T22:57:08.406616+0000","last_became_active":"2024-09-15T22:57:07.419226+0000","last_became_peered":"2024-09-15T22:57:07.419226+0000","last_unstale":"2024-09-15T22:57:08.406616+0000","last_undegraded":"2024-09-15T22:57:08.406616+0000","last_fullsized":"2024-09-15T22:57:08.406616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428677+0000","last_change":"2024-09-15T22:57:06.389493+0000","last_active":"2024-09-15T22:57:08.428677+0000","last_peered":"2024-09-15T22:57:08.428677+0000","last_clean":"2024-09-15T22:57:08.428677+0000","last_became_active":"2024-09-15T22:57:06.389159+0000","last_became_peered":"2024-09-15T22:57:06.389159+0000","last_unstale":"2024-09-15T22:57:08.428677+0000","last_undegraded":"2024-09-15T22:57:08.428677+0000","last_fullsized":"2024-09-15T22:57:08.428677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:16.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.687979+0000","last_change":"2024-09-15T22:57:07.414543+0000","last_active":"2024-09-15T22:57:08.687979+0000","last_peered":"2024-09-15T22:57:08.687979+0000","last_clean":"2024-09-15T22:57:08.687979+0000","last_became_active":"2024-09-15T22:57:07.413850+0000","last_became_peered":"2024-09-15T22:57:07.413850+0000","last_unstale":"2024-09-15T22:57:08.687979+0000","last_undegraded":"2024-09-15T22:57:08.687979+0000","last_fullsized":"2024-09-15T22:57:08.687979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:43.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406669+0000","last_change":"2024-09-15T22:57:06.399871+0000","last_active":"2024-09-15T22:57:08.406669+0000","last_peered":"2024-09-15T22:57:08.406669+0000","last_clean":"2024-09-15T22:57:08.406669+0000","last_became_active":"2024-09-15T22:57:06.399238+0000","last_became_peered":"2024-09-15T22:57:06.399238+0000","last_unstale":"2024-09-15T22:57:08.406669+0000","last_undegraded":"2024-09-15T22:57:08.406669+0000","last_fullsized":"2024-09-15T22:57:08.406669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406470+0000","last_change":"2024-09-15T22:57:07.412429+0000","last_active":"2024-09-15T22:57:08.406470+0000","last_peered":"2024-09-15T22:57:08.406470+0000","last_clean":"2024-09-15T22:57:08.406470+0000","last_became_active":"2024-09-15T22:57:07.412103+0000","last_became_peered":"2024-09-15T22:57:07.412103+0000","last_unstale":"2024-09-15T22:57:08.406470+0000","last_undegraded":"2024-09-15T22:57:08.406470+0000","last_fullsized":"2024-09-15T22:57:08.406470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428622+0000","last_change":"2024-09-15T22:57:06.409462+0000","last_active":"2024-09-15T22:57:08.428622+0000","last_peered":"2024-09-15T22:57:08.428622+0000","last_clean":"2024-09-15T22:57:08.428622+0000","last_became_active":"2024-09-15T22:57:06.408985+0000","last_became_peered":"2024-09-15T22:57:06.408985+0000","last_unstale":"2024-09-15T22:57:08.428622+0000","last_undegraded":"2024-09-15T22:57:08.428622+0000","last_fullsized":"2024-09-15T22:57:08.428622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688853+0000","last_change":"2024-09-15T22:57:07.411144+0000","last_active":"2024-09-15T22:57:08.688853+0000","last_peered":"2024-09-15T22:57:08.688853+0000","last_clean":"2024-09-15T22:57:08.688853+0000","last_became_active":"2024-09-15T22:57:07.410852+0000","last_became_peered":"2024-09-15T22:57:07.410852+0000","last_unstale":"2024-09-15T22:57:08.688853+0000","last_undegraded":"2024-09-15T22:57:08.688853+0000","last_fullsized":"2024-09-15T22:57:08.688853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409437+0000","last_change":"2024-09-15T22:57:06.400623+0000","last_active":"2024-09-15T22:57:08.409437+0000","last_peered":"2024-09-15T22:57:08.409437+0000","last_clean":"2024-09-15T22:57:08.409437+0000","last_became_active":"2024-09-15T22:57:06.399225+0000","last_became_peered":"2024-09-15T22:57:06.399225+0000","last_unstale":"2024-09-15T22:57:08.409437+0000","last_undegraded":"2024-09-15T22:57:08.409437+0000","last_fullsized":"2024-09-15T22:57:08.409437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:47.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408611+0000","last_change":"2024-09-15T22:57:07.421477+0000","last_active":"2024-09-15T22:57:08.408611+0000","last_peered":"2024-09-15T22:57:08.408611+0000","last_clean":"2024-09-15T22:57:08.408611+0000","last_became_active":"2024-09-15T22:57:07.420757+0000","last_became_peered":"2024-09-15T22:57:07.420757+0000","last_unstale":"2024-09-15T22:57:08.408611+0000","last_undegraded":"2024-09-15T22:57:08.408611+0000","last_fullsized":"2024-09-15T22:57:08.408611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689138+0000","last_change":"2024-09-15T22:57:06.415777+0000","last_active":"2024-09-15T22:57:08.689138+0000","last_peered":"2024-09-15T22:57:08.689138+0000","last_clean":"2024-09-15T22:57:08.689138+0000","last_became_active":"2024-09-15T22:57:06.415336+0000","last_became_peered":"2024-09-15T22:57:06.415336+0000","last_unstale":"2024-09-15T22:57:08.689138+0000","last_undegraded":"2024-09-15T22:57:08.689138+0000","last_fullsized":"2024-09-15T22:57:08.689138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:04.386363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632259+0000","last_change":"2024-09-15T22:57:07.432549+0000","last_active":"2024-09-15T22:57:08.632259+0000","last_peered":"2024-09-15T22:57:08.632259+0000","last_clean":"2024-09-15T22:57:08.632259+0000","last_became_active":"2024-09-15T22:57:07.431846+0000","last_became_peered":"2024-09-15T22:57:07.431846+0000","last_unstale":"2024-09-15T22:57:08.632259+0000","last_undegraded":"2024-09-15T22:57:08.632259+0000","last_fullsized":"2024-09-15T22:57:08.632259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688106+0000","last_change":"2024-09-15T22:57:06.412303+0000","last_active":"2024-09-15T22:57:08.688106+0000","last_peered":"2024-09-15T22:57:08.688106+0000","last_clean":"2024-09-15T22:57:08.688106+0000","last_became_active":"2024-09-15T22:57:06.411608+0000","last_became_peered":"2024-09-15T22:57:06.411608+0000","last_unstale":"2024-09-15T22:57:08.688106+0000","last_undegraded":"2024-09-15T22:57:08.688106+0000","last_fullsized":"2024-09-15T22:57:08.688106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632679+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:08.632679+0000","last_peered":"2024-09-15T22:57:08.632679+0000","last_clean":"2024-09-15T22:57:08.632679+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:08.632679+0000","last_undegraded":"2024-09-15T22:57:08.632679+0000","last_fullsized":"2024-09-15T22:57:08.632679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:15.064 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:57:15.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:57:15.993 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:16.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 Processor -- start 2024-09-15T22:57:16.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 -- start start 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1bec0b5200 0x7f1bec15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec0cca90 0x7f1bec0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bec0b55e0 con 0x7f1bec0b1dc0 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1bec0ce3b0 con 0x7f1bec0b5200 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf32a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec15c5f0 con 0x7f1bec0cca90 2024-09-15T22:57:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1bec0b5200 0x7f1bec15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1bec0b5200 0x7f1bec15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40288/0 (socket says 172.21.15.28:40288) 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 -- 172.21.15.28:0/3122181625 learned_addr learned my addr 172.21.15.28:0/3122181625 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf0840640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec0cca90 0x7f1bec0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 -- 172.21.15.28:0/3122181625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec0cca90 msgr2=0x7f1bec0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec0cca90 0x7f1bec0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 -- 172.21.15.28:0/3122181625 >> v1:172.21.15.131:6789/0 conn(0x7f1bec0b1dc0 legacy=0x7f1bec0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1bf1041640 1 -- 172.21.15.28:0/3122181625 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec0b4910 con 0x7f1bec0b5200 2024-09-15T22:57:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.126+0000 7f1be3fff640 1 -- 172.21.15.28:0/3122181625 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634792522 0 0) 0x7f1bec0b55e0 con 0x7f1bec0b1dc0 2024-09-15T22:57:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf1041640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0b5200 0x7f1bec15c0b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1be800bb40 tx=0x7f1be801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6338bbdab688caae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1be3fff640 1 -- 172.21.15.28:0/3122181625 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80b4070 con 0x7f1bec0b5200 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1be3fff640 1 -- 172.21.15.28:0/3122181625 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be80a7a50 con 0x7f1bec0b5200 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1be3fff640 1 -- 172.21.15.28:0/3122181625 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80a7e20 con 0x7f1bec0b5200 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- 172.21.15.28:0/3122181625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0b5200 msgr2=0x7f1bec15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0b5200 0x7f1bec15c0b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1be800bb40 tx=0x7f1be801eb80 comp rx=0 tx=0).stop 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- 172.21.15.28:0/3122181625 shutdown_connections 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec0cca90 0x7f1bec0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/3122181625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0b5200 0x7f1bec15c0b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- 172.21.15.28:0/3122181625 >> 172.21.15.28:0/3122181625 conn(0x7f1bec06bcc0 msgr2=0x7f1bec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- 172.21.15.28:0/3122181625 shutdown_connections 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- 172.21.15.28:0/3122181625 wait complete. 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 Processor -- start 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.130+0000 7f1bf32a5640 1 -- start start 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bec0b1dc0 0x7f1bec154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 0x7f1bec0aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0b4070 con 0x7f1bec0cca90 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0cd8c0 con 0x7f1bec0b1dc0 2024-09-15T22:57:16.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec0b25e0 con 0x7f1bec072630 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40292/0 (socket says 172.21.15.28:40292) 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 -- 172.21.15.28:0/2525237785 learned_addr learned my addr 172.21.15.28:0/2525237785 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf1041640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bec0b1dc0 0x7f1bec154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf1842640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 0x7f1bec0aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 -- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 msgr2=0x7f1bec0aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 0x7f1bec0aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 -- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bec0b1dc0 msgr2=0x7f1bec154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bec0b1dc0 0x7f1bec154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 -- 172.21.15.28:0/2525237785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec1f8b50 con 0x7f1bec0cca90 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf1842640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 0x7f1bec0aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf0840640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00e8a0 tx=0x7f1bdc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc017070 con 0x7f1bec0cca90 2024-09-15T22:57:16.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00c940 con 0x7f1bec0cca90 2024-09-15T22:57:16.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00cd10 con 0x7f1bec0cca90 2024-09-15T22:57:16.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec0ab500 con 0x7f1bec0cca90 2024-09-15T22:57:16.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec1f90d0 con 0x7f1bec0cca90 2024-09-15T22:57:16.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec072a40 con 0x7f1bec0cca90 2024-09-15T22:57:16.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bdc01a070 con 0x7f1bec0cca90 2024-09-15T22:57:16.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 0x7f1bd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf1041640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 0x7f1bd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1bdc085c00 con 0x7f1bec0cca90 2024-09-15T22:57:16.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.134+0000 7f1bf1041640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 0x7f1bd0069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1be80b1000 tx=0x7f1be8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.138+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1bec072a40 con 0x7f1bec0cca90 2024-09-15T22:57:16.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.302+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bec15c0b0 con 0x7f1bd00678f0 2024-09-15T22:57:16.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.310+0000 7f1be1ffb640 1 -- 172.21.15.28:0/2525237785 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251839 (secure 0 0 0) 0x7f1bec15c0b0 con 0x7f1bd00678f0 2024-09-15T22:57:16.315 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:16.316 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:16.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 msgr2=0x7f1bd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 0x7f1bd0069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1be80b1000 tx=0x7f1be8008040 comp rx=0 tx=0).stop 2024-09-15T22:57:16.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 msgr2=0x7f1bec0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00e8a0 tx=0x7f1bdc00ed60 comp rx=0 tx=0).stop 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 shutdown_connections 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bec072630 0x7f1bec0aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bec0cca90 0x7f1bec0720f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1bd00678f0 0x7f1bd0069db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 --2- 172.21.15.28:0/2525237785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bec0b1dc0 0x7f1bec154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 >> 172.21.15.28:0/2525237785 conn(0x7f1bec06bcc0 msgr2=0x7f1bec15d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 shutdown_connections 2024-09-15T22:57:16.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.314+0000 7f1bf32a5640 1 -- 172.21.15.28:0/2525237785 wait complete. 2024-09-15T22:57:16.333 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-15T22:57:15.882604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236832,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737888,"statfs":{"total":773094113280,"available":772851597312,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.502832"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688426+0000","last_change":"2024-09-15T22:57:07.422481+0000","last_active":"2024-09-15T22:57:08.688426+0000","last_peered":"2024-09-15T22:57:08.688426+0000","last_clean":"2024-09-15T22:57:08.688426+0000","last_became_active":"2024-09-15T22:57:07.421724+0000","last_became_peered":"2024-09-15T22:57:07.421724+0000","last_unstale":"2024-09-15T22:57:08.688426+0000","last_undegraded":"2024-09-15T22:57:08.688426+0000","last_fullsized":"2024-09-15T22:57:08.688426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:05.395270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691428+0000","last_change":"2024-09-15T22:57:07.414811+0000","last_active":"2024-09-15T22:57:08.691428+0000","last_peered":"2024-09-15T22:57:08.691428+0000","last_clean":"2024-09-15T22:57:08.691428+0000","last_became_active":"2024-09-15T22:57:07.412780+0000","last_became_peered":"2024-09-15T22:57:07.412780+0000","last_unstale":"2024-09-15T22:57:08.691428+0000","last_undegraded":"2024-09-15T22:57:08.691428+0000","last_fullsized":"2024-09-15T22:57:08.691428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:34.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408209+0000","last_change":"2024-09-15T22:57:07.415251+0000","last_active":"2024-09-15T22:57:08.408209+0000","last_peered":"2024-09-15T22:57:08.408209+0000","last_clean":"2024-09-15T22:57:08.408209+0000","last_became_active":"2024-09-15T22:57:07.413708+0000","last_became_peered":"2024-09-15T22:57:07.413708+0000","last_unstale":"2024-09-15T22:57:08.408209+0000","last_undegraded":"2024-09-15T22:57:08.408209+0000","last_fullsized":"2024-09-15T22:57:08.408209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428567+0000","last_change":"2024-09-15T22:57:07.408039+0000","last_active":"2024-09-15T22:57:08.428567+0000","last_peered":"2024-09-15T22:57:08.428567+0000","last_clean":"2024-09-15T22:57:08.428567+0000","last_became_active":"2024-09-15T22:57:07.403618+0000","last_became_peered":"2024-09-15T22:57:07.403618+0000","last_unstale":"2024-09-15T22:57:08.428567+0000","last_undegraded":"2024-09-15T22:57:08.428567+0000","last_fullsized":"2024-09-15T22:57:08.428567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689773+0000","last_change":"2024-09-15T22:57:07.418137+0000","last_active":"2024-09-15T22:57:08.689773+0000","last_peered":"2024-09-15T22:57:08.689773+0000","last_clean":"2024-09-15T22:57:08.689773+0000","last_became_active":"2024-09-15T22:57:07.417768+0000","last_became_peered":"2024-09-15T22:57:07.417768+0000","last_unstale":"2024-09-15T22:57:08.689773+0000","last_undegraded":"2024-09-15T22:57:08.689773+0000","last_fullsized":"2024-09-15T22:57:08.689773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:40.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690489+0000","last_change":"2024-09-15T22:57:07.410791+0000","last_active":"2024-09-15T22:57:08.690489+0000","last_peered":"2024-09-15T22:57:08.690489+0000","last_clean":"2024-09-15T22:57:08.690489+0000","last_became_active":"2024-09-15T22:57:07.410385+0000","last_became_peered":"2024-09-15T22:57:07.410385+0000","last_unstale":"2024-09-15T22:57:08.690489+0000","last_undegraded":"2024-09-15T22:57:08.690489+0000","last_fullsized":"2024-09-15T22:57:08.690489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632493+0000","last_change":"2024-09-15T22:57:07.435315+0000","last_active":"2024-09-15T22:57:08.632493+0000","last_peered":"2024-09-15T22:57:08.632493+0000","last_clean":"2024-09-15T22:57:08.632493+0000","last_became_active":"2024-09-15T22:57:07.433936+0000","last_became_peered":"2024-09-15T22:57:07.433936+0000","last_unstale":"2024-09-15T22:57:08.632493+0000","last_undegraded":"2024-09-15T22:57:08.632493+0000","last_fullsized":"2024-09-15T22:57:08.632493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631705+0000","last_change":"2024-09-15T22:57:07.430306+0000","last_active":"2024-09-15T22:57:08.631705+0000","last_peered":"2024-09-15T22:57:08.631705+0000","last_clean":"2024-09-15T22:57:08.631705+0000","last_became_active":"2024-09-15T22:57:07.429327+0000","last_became_peered":"2024-09-15T22:57:07.429327+0000","last_unstale":"2024-09-15T22:57:08.631705+0000","last_undegraded":"2024-09-15T22:57:08.631705+0000","last_fullsized":"2024-09-15T22:57:08.631705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409967+0000","last_change":"2024-09-15T22:57:07.407409+0000","last_active":"2024-09-15T22:57:08.409967+0000","last_peered":"2024-09-15T22:57:08.409967+0000","last_clean":"2024-09-15T22:57:08.409967+0000","last_became_active":"2024-09-15T22:57:07.403239+0000","last_became_peered":"2024-09-15T22:57:07.403239+0000","last_unstale":"2024-09-15T22:57:08.409967+0000","last_undegraded":"2024-09-15T22:57:08.409967+0000","last_fullsized":"2024-09-15T22:57:08.409967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428974+0000","last_change":"2024-09-15T22:57:07.418481+0000","last_active":"2024-09-15T22:57:08.428974+0000","last_peered":"2024-09-15T22:57:08.428974+0000","last_clean":"2024-09-15T22:57:08.428974+0000","last_became_active":"2024-09-15T22:57:07.418179+0000","last_became_peered":"2024-09-15T22:57:07.418179+0000","last_unstale":"2024-09-15T22:57:08.428974+0000","last_undegraded":"2024-09-15T22:57:08.428974+0000","last_fullsized":"2024-09-15T22:57:08.428974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632496+0000","last_change":"2024-09-15T22:57:07.435002+0000","last_active":"2024-09-15T22:57:08.632496+0000","last_peered":"2024-09-15T22:57:08.632496+0000","last_clean":"2024-09-15T22:57:08.632496+0000","last_became_active":"2024-09-15T22:57:07.431791+0000","last_became_peered":"2024-09-15T22:57:07.431791+0000","last_unstale":"2024-09-15T22:57:08.632496+0000","last_undegraded":"2024-09-15T22:57:08.632496+0000","last_fullsized":"2024-09-15T22:57:08.632496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:18.513009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407709+0000","last_change":"2024-09-15T22:57:07.415567+0000","last_active":"2024-09-15T22:57:08.407709+0000","last_peered":"2024-09-15T22:57:08.407709+0000","last_clean":"2024-09-15T22:57:08.407709+0000","last_became_active":"2024-09-15T22:57:07.414859+0000","last_became_peered":"2024-09-15T22:57:07.414859+0000","last_unstale":"2024-09-15T22:57:08.407709+0000","last_undegraded":"2024-09-15T22:57:08.407709+0000","last_fullsized":"2024-09-15T22:57:08.407709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:16.107310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689796+0000","last_change":"2024-09-15T22:57:07.404912+0000","last_active":"2024-09-15T22:57:08.689796+0000","last_peered":"2024-09-15T22:57:08.689796+0000","last_clean":"2024-09-15T22:57:08.689796+0000","last_became_active":"2024-09-15T22:57:07.404646+0000","last_became_peered":"2024-09-15T22:57:07.404646+0000","last_unstale":"2024-09-15T22:57:08.689796+0000","last_undegraded":"2024-09-15T22:57:08.689796+0000","last_fullsized":"2024-09-15T22:57:08.689796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:59.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690626+0000","last_change":"2024-09-15T22:57:07.407611+0000","last_active":"2024-09-15T22:57:08.690626+0000","last_peered":"2024-09-15T22:57:08.690626+0000","last_clean":"2024-09-15T22:57:08.690626+0000","last_became_active":"2024-09-15T22:57:07.407094+0000","last_became_peered":"2024-09-15T22:57:07.407094+0000","last_unstale":"2024-09-15T22:57:08.690626+0000","last_undegraded":"2024-09-15T22:57:08.690626+0000","last_fullsized":"2024-09-15T22:57:08.690626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407468+0000","last_change":"2024-09-15T22:57:07.426899+0000","last_active":"2024-09-15T22:57:08.407468+0000","last_peered":"2024-09-15T22:57:08.407468+0000","last_clean":"2024-09-15T22:57:08.407468+0000","last_became_active":"2024-09-15T22:57:07.425429+0000","last_became_peered":"2024-09-15T22:57:07.425429+0000","last_unstale":"2024-09-15T22:57:08.407468+0000","last_undegraded":"2024-09-15T22:57:08.407468+0000","last_fullsized":"2024-09-15T22:57:08.407468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632524+0000","last_change":"2024-09-15T22:57:07.435259+0000","last_active":"2024-09-15T22:57:08.632524+0000","last_peered":"2024-09-15T22:57:08.632524+0000","last_clean":"2024-09-15T22:57:08.632524+0000","last_became_active":"2024-09-15T22:57:07.434672+0000","last_became_peered":"2024-09-15T22:57:07.434672+0000","last_unstale":"2024-09-15T22:57:08.632524+0000","last_undegraded":"2024-09-15T22:57:08.632524+0000","last_fullsized":"2024-09-15T22:57:08.632524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632732+0000","last_change":"2024-09-15T22:57:07.436431+0000","last_active":"2024-09-15T22:57:08.632732+0000","last_peered":"2024-09-15T22:57:08.632732+0000","last_clean":"2024-09-15T22:57:08.632732+0000","last_became_active":"2024-09-15T22:57:07.435624+0000","last_became_peered":"2024-09-15T22:57:07.435624+0000","last_unstale":"2024-09-15T22:57:08.632732+0000","last_undegraded":"2024-09-15T22:57:08.632732+0000","last_fullsized":"2024-09-15T22:57:08.632732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691316+0000","last_change":"2024-09-15T22:57:07.423612+0000","last_active":"2024-09-15T22:57:08.691316+0000","last_peered":"2024-09-15T22:57:08.691316+0000","last_clean":"2024-09-15T22:57:08.691316+0000","last_became_active":"2024-09-15T22:57:07.423279+0000","last_became_peered":"2024-09-15T22:57:07.423279+0000","last_unstale":"2024-09-15T22:57:08.691316+0000","last_undegraded":"2024-09-15T22:57:08.691316+0000","last_fullsized":"2024-09-15T22:57:08.691316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:18.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690687+0000","last_change":"2024-09-15T22:57:07.419227+0000","last_active":"2024-09-15T22:57:08.690687+0000","last_peered":"2024-09-15T22:57:08.690687+0000","last_clean":"2024-09-15T22:57:08.690687+0000","last_became_active":"2024-09-15T22:57:07.416882+0000","last_became_peered":"2024-09-15T22:57:07.416882+0000","last_unstale":"2024-09-15T22:57:08.690687+0000","last_undegraded":"2024-09-15T22:57:08.690687+0000","last_fullsized":"2024-09-15T22:57:08.690687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689823+0000","last_change":"2024-09-15T22:57:07.406087+0000","last_active":"2024-09-15T22:57:08.689823+0000","last_peered":"2024-09-15T22:57:08.689823+0000","last_clean":"2024-09-15T22:57:08.689823+0000","last_became_active":"2024-09-15T22:57:07.405688+0000","last_became_peered":"2024-09-15T22:57:07.405688+0000","last_unstale":"2024-09-15T22:57:08.689823+0000","last_undegraded":"2024-09-15T22:57:08.689823+0000","last_fullsized":"2024-09-15T22:57:08.689823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:32.357178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409112+0000","last_change":"2024-09-15T22:57:07.425157+0000","last_active":"2024-09-15T22:57:08.409112+0000","last_peered":"2024-09-15T22:57:08.409112+0000","last_clean":"2024-09-15T22:57:08.409112+0000","last_became_active":"2024-09-15T22:57:07.424459+0000","last_became_peered":"2024-09-15T22:57:07.424459+0000","last_unstale":"2024-09-15T22:57:08.409112+0000","last_undegraded":"2024-09-15T22:57:08.409112+0000","last_fullsized":"2024-09-15T22:57:08.409112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409214+0000","last_change":"2024-09-15T22:57:07.419020+0000","last_active":"2024-09-15T22:57:08.409214+0000","last_peered":"2024-09-15T22:57:08.409214+0000","last_clean":"2024-09-15T22:57:08.409214+0000","last_became_active":"2024-09-15T22:57:07.418272+0000","last_became_peered":"2024-09-15T22:57:07.418272+0000","last_unstale":"2024-09-15T22:57:08.409214+0000","last_undegraded":"2024-09-15T22:57:08.409214+0000","last_fullsized":"2024-09-15T22:57:08.409214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:09.107627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.405815+0000","last_change":"2024-09-15T22:57:07.414552+0000","last_active":"2024-09-15T22:57:08.405815+0000","last_peered":"2024-09-15T22:57:08.405815+0000","last_clean":"2024-09-15T22:57:08.405815+0000","last_became_active":"2024-09-15T22:57:07.414153+0000","last_became_peered":"2024-09-15T22:57:07.414153+0000","last_unstale":"2024-09-15T22:57:08.405815+0000","last_undegraded":"2024-09-15T22:57:08.405815+0000","last_fullsized":"2024-09-15T22:57:08.405815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:58.690688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406902+0000","last_change":"2024-09-15T22:57:07.407145+0000","last_active":"2024-09-15T22:57:08.406902+0000","last_peered":"2024-09-15T22:57:08.406902+0000","last_clean":"2024-09-15T22:57:08.406902+0000","last_became_active":"2024-09-15T22:57:07.406323+0000","last_became_peered":"2024-09-15T22:57:07.406323+0000","last_unstale":"2024-09-15T22:57:08.406902+0000","last_undegraded":"2024-09-15T22:57:08.406902+0000","last_fullsized":"2024-09-15T22:57:08.406902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429032+0000","last_change":"2024-09-15T22:57:07.438561+0000","last_active":"2024-09-15T22:57:08.429032+0000","last_peered":"2024-09-15T22:57:08.429032+0000","last_clean":"2024-09-15T22:57:08.429032+0000","last_became_active":"2024-09-15T22:57:07.438342+0000","last_became_peered":"2024-09-15T22:57:07.438342+0000","last_unstale":"2024-09-15T22:57:08.429032+0000","last_undegraded":"2024-09-15T22:57:08.429032+0000","last_fullsized":"2024-09-15T22:57:08.429032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:10.332802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691548+0000","last_change":"2024-09-15T22:57:07.414994+0000","last_active":"2024-09-15T22:57:08.691548+0000","last_peered":"2024-09-15T22:57:08.691548+0000","last_clean":"2024-09-15T22:57:08.691548+0000","last_became_active":"2024-09-15T22:57:07.414712+0000","last_became_peered":"2024-09-15T22:57:07.414712+0000","last_unstale":"2024-09-15T22:57:08.691548+0000","last_undegraded":"2024-09-15T22:57:08.691548+0000","last_fullsized":"2024-09-15T22:57:08.691548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:12.113967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429009+0000","last_change":"2024-09-15T22:57:07.413192+0000","last_active":"2024-09-15T22:57:08.429009+0000","last_peered":"2024-09-15T22:57:08.429009+0000","last_clean":"2024-09-15T22:57:08.429009+0000","last_became_active":"2024-09-15T22:57:07.411535+0000","last_became_peered":"2024-09-15T22:57:07.411535+0000","last_unstale":"2024-09-15T22:57:08.429009+0000","last_undegraded":"2024-09-15T22:57:08.429009+0000","last_fullsized":"2024-09-15T22:57:08.429009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407855+0000","last_change":"2024-09-15T22:57:07.396994+0000","last_active":"2024-09-15T22:57:08.407855+0000","last_peered":"2024-09-15T22:57:08.407855+0000","last_clean":"2024-09-15T22:57:08.407855+0000","last_became_active":"2024-09-15T22:57:07.395762+0000","last_became_peered":"2024-09-15T22:57:07.395762+0000","last_unstale":"2024-09-15T22:57:08.407855+0000","last_undegraded":"2024-09-15T22:57:08.407855+0000","last_fullsized":"2024-09-15T22:57:08.407855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409839+0000","last_change":"2024-09-15T22:57:07.419508+0000","last_active":"2024-09-15T22:57:08.409839+0000","last_peered":"2024-09-15T22:57:08.409839+0000","last_clean":"2024-09-15T22:57:08.409839+0000","last_became_active":"2024-09-15T22:57:07.418717+0000","last_became_peered":"2024-09-15T22:57:07.418717+0000","last_unstale":"2024-09-15T22:57:08.409839+0000","last_undegraded":"2024-09-15T22:57:08.409839+0000","last_fullsized":"2024-09-15T22:57:08.409839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:46.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631996+0000","last_change":"2024-09-15T22:57:07.434428+0000","last_active":"2024-09-15T22:57:08.631996+0000","last_peered":"2024-09-15T22:57:08.631996+0000","last_clean":"2024-09-15T22:57:08.631996+0000","last_became_active":"2024-09-15T22:57:07.433439+0000","last_became_peered":"2024-09-15T22:57:07.433439+0000","last_unstale":"2024-09-15T22:57:08.631996+0000","last_undegraded":"2024-09-15T22:57:08.631996+0000","last_fullsized":"2024-09-15T22:57:08.631996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:26.491759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688154+0000","last_change":"2024-09-15T22:57:07.422941+0000","last_active":"2024-09-15T22:57:08.688154+0000","last_peered":"2024-09-15T22:57:08.688154+0000","last_clean":"2024-09-15T22:57:08.688154+0000","last_became_active":"2024-09-15T22:57:07.422106+0000","last_became_peered":"2024-09-15T22:57:07.422106+0000","last_unstale":"2024-09-15T22:57:08.688154+0000","last_undegraded":"2024-09-15T22:57:08.688154+0000","last_fullsized":"2024-09-15T22:57:08.688154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:09.004375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631605+0000","last_change":"2024-09-15T22:57:07.434147+0000","last_active":"2024-09-15T22:57:08.631605+0000","last_peered":"2024-09-15T22:57:08.631605+0000","last_clean":"2024-09-15T22:57:08.631605+0000","last_became_active":"2024-09-15T22:57:07.433483+0000","last_became_peered":"2024-09-15T22:57:07.433483+0000","last_unstale":"2024-09-15T22:57:08.631605+0000","last_undegraded":"2024-09-15T22:57:08.631605+0000","last_fullsized":"2024-09-15T22:57:08.631605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:36.323708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406724+0000","last_change":"2024-09-15T22:57:07.431680+0000","last_active":"2024-09-15T22:57:08.406724+0000","last_peered":"2024-09-15T22:57:08.406724+0000","last_clean":"2024-09-15T22:57:08.406724+0000","last_became_active":"2024-09-15T22:57:07.431296+0000","last_became_peered":"2024-09-15T22:57:07.431296+0000","last_unstale":"2024-09-15T22:57:08.406724+0000","last_undegraded":"2024-09-15T22:57:08.406724+0000","last_fullsized":"2024-09-15T22:57:08.406724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688577+0000","last_change":"2024-09-15T22:57:06.414917+0000","last_active":"2024-09-15T22:57:08.688577+0000","last_peered":"2024-09-15T22:57:08.688577+0000","last_clean":"2024-09-15T22:57:08.688577+0000","last_became_active":"2024-09-15T22:57:06.414118+0000","last_became_peered":"2024-09-15T22:57:06.414118+0000","last_unstale":"2024-09-15T22:57:08.688577+0000","last_undegraded":"2024-09-15T22:57:08.688577+0000","last_fullsized":"2024-09-15T22:57:08.688577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688437+0000","last_change":"2024-09-15T22:57:07.409723+0000","last_active":"2024-09-15T22:57:08.688437+0000","last_peered":"2024-09-15T22:57:08.688437+0000","last_clean":"2024-09-15T22:57:08.688437+0000","last_became_active":"2024-09-15T22:57:07.409014+0000","last_became_peered":"2024-09-15T22:57:07.409014+0000","last_unstale":"2024-09-15T22:57:08.688437+0000","last_undegraded":"2024-09-15T22:57:08.688437+0000","last_fullsized":"2024-09-15T22:57:08.688437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:17.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406444+0000","last_change":"2024-09-15T22:57:06.412023+0000","last_active":"2024-09-15T22:57:08.406444+0000","last_peered":"2024-09-15T22:57:08.406444+0000","last_clean":"2024-09-15T22:57:08.406444+0000","last_became_active":"2024-09-15T22:57:06.411659+0000","last_became_peered":"2024-09-15T22:57:06.411659+0000","last_unstale":"2024-09-15T22:57:08.406444+0000","last_undegraded":"2024-09-15T22:57:08.406444+0000","last_fullsized":"2024-09-15T22:57:08.406444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409494+0000","last_change":"2024-09-15T22:57:07.423198+0000","last_active":"2024-09-15T22:57:08.409494+0000","last_peered":"2024-09-15T22:57:08.409494+0000","last_clean":"2024-09-15T22:57:08.409494+0000","last_became_active":"2024-09-15T22:57:07.422471+0000","last_became_peered":"2024-09-15T22:57:07.422471+0000","last_unstale":"2024-09-15T22:57:08.409494+0000","last_undegraded":"2024-09-15T22:57:08.409494+0000","last_fullsized":"2024-09-15T22:57:08.409494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:18.206624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691206+0000","last_change":"2024-09-15T22:57:06.396932+0000","last_active":"2024-09-15T22:57:08.691206+0000","last_peered":"2024-09-15T22:57:08.691206+0000","last_clean":"2024-09-15T22:57:08.691206+0000","last_became_active":"2024-09-15T22:57:06.396128+0000","last_became_peered":"2024-09-15T22:57:06.396128+0000","last_unstale":"2024-09-15T22:57:08.691206+0000","last_undegraded":"2024-09-15T22:57:08.691206+0000","last_fullsized":"2024-09-15T22:57:08.691206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:50.738771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429291+0000","last_change":"2024-09-15T22:57:07.413424+0000","last_active":"2024-09-15T22:57:08.429291+0000","last_peered":"2024-09-15T22:57:08.429291+0000","last_clean":"2024-09-15T22:57:08.429291+0000","last_became_active":"2024-09-15T22:57:07.411914+0000","last_became_peered":"2024-09-15T22:57:07.411914+0000","last_unstale":"2024-09-15T22:57:08.429291+0000","last_undegraded":"2024-09-15T22:57:08.429291+0000","last_fullsized":"2024-09-15T22:57:08.429291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:53.831558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689719+0000","last_change":"2024-09-15T22:57:06.389724+0000","last_active":"2024-09-15T22:57:08.689719+0000","last_peered":"2024-09-15T22:57:08.689719+0000","last_clean":"2024-09-15T22:57:08.689719+0000","last_became_active":"2024-09-15T22:57:06.389420+0000","last_became_peered":"2024-09-15T22:57:06.389420+0000","last_unstale":"2024-09-15T22:57:08.689719+0000","last_undegraded":"2024-09-15T22:57:08.689719+0000","last_fullsized":"2024-09-15T22:57:08.689719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:16.912850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632632+0000","last_change":"2024-09-15T22:57:07.434140+0000","last_active":"2024-09-15T22:57:08.632632+0000","last_peered":"2024-09-15T22:57:08.632632+0000","last_clean":"2024-09-15T22:57:08.632632+0000","last_became_active":"2024-09-15T22:57:07.432682+0000","last_became_peered":"2024-09-15T22:57:07.432682+0000","last_unstale":"2024-09-15T22:57:08.632632+0000","last_undegraded":"2024-09-15T22:57:08.632632+0000","last_fullsized":"2024-09-15T22:57:08.632632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409387+0000","last_change":"2024-09-15T22:57:06.406695+0000","last_active":"2024-09-15T22:57:08.409387+0000","last_peered":"2024-09-15T22:57:08.409387+0000","last_clean":"2024-09-15T22:57:08.409387+0000","last_became_active":"2024-09-15T22:57:06.405989+0000","last_became_peered":"2024-09-15T22:57:06.405989+0000","last_unstale":"2024-09-15T22:57:08.409387+0000","last_undegraded":"2024-09-15T22:57:08.409387+0000","last_fullsized":"2024-09-15T22:57:08.409387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407859+0000","last_change":"2024-09-15T22:57:07.415274+0000","last_active":"2024-09-15T22:57:08.407859+0000","last_peered":"2024-09-15T22:57:08.407859+0000","last_clean":"2024-09-15T22:57:08.407859+0000","last_became_active":"2024-09-15T22:57:07.414432+0000","last_became_peered":"2024-09-15T22:57:07.414432+0000","last_unstale":"2024-09-15T22:57:08.407859+0000","last_undegraded":"2024-09-15T22:57:08.407859+0000","last_fullsized":"2024-09-15T22:57:08.407859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409468+0000","last_change":"2024-09-15T22:57:06.406784+0000","last_active":"2024-09-15T22:57:08.409468+0000","last_peered":"2024-09-15T22:57:08.409468+0000","last_clean":"2024-09-15T22:57:08.409468+0000","last_became_active":"2024-09-15T22:57:06.406044+0000","last_became_peered":"2024-09-15T22:57:06.406044+0000","last_unstale":"2024-09-15T22:57:08.409468+0000","last_undegraded":"2024-09-15T22:57:08.409468+0000","last_fullsized":"2024-09-15T22:57:08.409468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:11.807980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407829+0000","last_change":"2024-09-15T22:57:07.426916+0000","last_active":"2024-09-15T22:57:08.407829+0000","last_peered":"2024-09-15T22:57:08.407829+0000","last_clean":"2024-09-15T22:57:08.407829+0000","last_became_active":"2024-09-15T22:57:07.426135+0000","last_became_peered":"2024-09-15T22:57:07.426135+0000","last_unstale":"2024-09-15T22:57:08.407829+0000","last_undegraded":"2024-09-15T22:57:08.407829+0000","last_fullsized":"2024-09-15T22:57:08.407829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688768+0000","last_change":"2024-09-15T22:57:06.396319+0000","last_active":"2024-09-15T22:57:08.688768+0000","last_peered":"2024-09-15T22:57:08.688768+0000","last_clean":"2024-09-15T22:57:08.688768+0000","last_became_active":"2024-09-15T22:57:06.395943+0000","last_became_peered":"2024-09-15T22:57:06.395943+0000","last_unstale":"2024-09-15T22:57:08.688768+0000","last_undegraded":"2024-09-15T22:57:08.688768+0000","last_fullsized":"2024-09-15T22:57:08.688768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428210+0000","last_change":"2024-09-15T22:57:07.427285+0000","last_active":"2024-09-15T22:57:08.428210+0000","last_peered":"2024-09-15T22:57:08.428210+0000","last_clean":"2024-09-15T22:57:08.428210+0000","last_became_active":"2024-09-15T22:57:07.426924+0000","last_became_peered":"2024-09-15T22:57:07.426924+0000","last_unstale":"2024-09-15T22:57:08.428210+0000","last_undegraded":"2024-09-15T22:57:08.428210+0000","last_fullsized":"2024-09-15T22:57:08.428210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408072+0000","last_change":"2024-09-15T22:57:06.403648+0000","last_active":"2024-09-15T22:57:08.408072+0000","last_peered":"2024-09-15T22:57:08.408072+0000","last_clean":"2024-09-15T22:57:08.408072+0000","last_became_active":"2024-09-15T22:57:06.402925+0000","last_became_peered":"2024-09-15T22:57:06.402925+0000","last_unstale":"2024-09-15T22:57:08.408072+0000","last_undegraded":"2024-09-15T22:57:08.408072+0000","last_fullsized":"2024-09-15T22:57:08.408072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408608+0000","last_change":"2024-09-15T22:57:07.408441+0000","last_active":"2024-09-15T22:57:08.408608+0000","last_peered":"2024-09-15T22:57:08.408608+0000","last_clean":"2024-09-15T22:57:08.408608+0000","last_became_active":"2024-09-15T22:57:07.407246+0000","last_became_peered":"2024-09-15T22:57:07.407246+0000","last_unstale":"2024-09-15T22:57:08.408608+0000","last_undegraded":"2024-09-15T22:57:08.408608+0000","last_fullsized":"2024-09-15T22:57:08.408608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:35.371785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691475+0000","last_change":"2024-09-15T22:57:06.415706+0000","last_active":"2024-09-15T22:57:08.691475+0000","last_peered":"2024-09-15T22:57:08.691475+0000","last_clean":"2024-09-15T22:57:08.691475+0000","last_became_active":"2024-09-15T22:57:06.415352+0000","last_became_peered":"2024-09-15T22:57:06.415352+0000","last_unstale":"2024-09-15T22:57:08.691475+0000","last_undegraded":"2024-09-15T22:57:08.691475+0000","last_fullsized":"2024-09-15T22:57:08.691475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:57.681781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691271+0000","last_change":"2024-09-15T22:57:07.420932+0000","last_active":"2024-09-15T22:57:08.691271+0000","last_peered":"2024-09-15T22:57:08.691271+0000","last_clean":"2024-09-15T22:57:08.691271+0000","last_became_active":"2024-09-15T22:57:07.420671+0000","last_became_peered":"2024-09-15T22:57:07.420671+0000","last_unstale":"2024-09-15T22:57:08.691271+0000","last_undegraded":"2024-09-15T22:57:08.691271+0000","last_fullsized":"2024-09-15T22:57:08.691271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:29.808680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406614+0000","last_change":"2024-09-15T22:57:06.399559+0000","last_active":"2024-09-15T22:57:08.406614+0000","last_peered":"2024-09-15T22:57:08.406614+0000","last_clean":"2024-09-15T22:57:08.406614+0000","last_became_active":"2024-09-15T22:57:06.399192+0000","last_became_peered":"2024-09-15T22:57:06.399192+0000","last_unstale":"2024-09-15T22:57:08.406614+0000","last_undegraded":"2024-09-15T22:57:08.406614+0000","last_fullsized":"2024-09-15T22:57:08.406614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690967+0000","last_change":"2024-09-15T22:57:07.415974+0000","last_active":"2024-09-15T22:57:08.690967+0000","last_peered":"2024-09-15T22:57:08.690967+0000","last_clean":"2024-09-15T22:57:08.690967+0000","last_became_active":"2024-09-15T22:57:07.415666+0000","last_became_peered":"2024-09-15T22:57:07.415666+0000","last_unstale":"2024-09-15T22:57:08.690967+0000","last_undegraded":"2024-09-15T22:57:08.690967+0000","last_fullsized":"2024-09-15T22:57:08.690967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408478+0000","last_change":"2024-09-15T22:57:06.416238+0000","last_active":"2024-09-15T22:57:08.408478+0000","last_peered":"2024-09-15T22:57:08.408478+0000","last_clean":"2024-09-15T22:57:08.408478+0000","last_became_active":"2024-09-15T22:57:06.415550+0000","last_became_peered":"2024-09-15T22:57:06.415550+0000","last_unstale":"2024-09-15T22:57:08.408478+0000","last_undegraded":"2024-09-15T22:57:08.408478+0000","last_fullsized":"2024-09-15T22:57:08.408478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:07.995468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407783+0000","last_change":"2024-09-15T22:57:07.415886+0000","last_active":"2024-09-15T22:57:08.407783+0000","last_peered":"2024-09-15T22:57:08.407783+0000","last_clean":"2024-09-15T22:57:08.407783+0000","last_became_active":"2024-09-15T22:57:07.414584+0000","last_became_peered":"2024-09-15T22:57:07.414584+0000","last_unstale":"2024-09-15T22:57:08.407783+0000","last_undegraded":"2024-09-15T22:57:08.407783+0000","last_fullsized":"2024-09-15T22:57:08.407783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.691493+0000","last_change":"2024-09-15T22:57:06.397779+0000","last_active":"2024-09-15T22:57:08.691493+0000","last_peered":"2024-09-15T22:57:08.691493+0000","last_clean":"2024-09-15T22:57:08.691493+0000","last_became_active":"2024-09-15T22:57:06.396940+0000","last_became_peered":"2024-09-15T22:57:06.396940+0000","last_unstale":"2024-09-15T22:57:08.691493+0000","last_undegraded":"2024-09-15T22:57:08.691493+0000","last_fullsized":"2024-09-15T22:57:08.691493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428477+0000","last_change":"2024-09-15T22:57:07.427292+0000","last_active":"2024-09-15T22:57:08.428477+0000","last_peered":"2024-09-15T22:57:08.428477+0000","last_clean":"2024-09-15T22:57:08.428477+0000","last_became_active":"2024-09-15T22:57:07.426935+0000","last_became_peered":"2024-09-15T22:57:07.426935+0000","last_unstale":"2024-09-15T22:57:08.428477+0000","last_undegraded":"2024-09-15T22:57:08.428477+0000","last_fullsized":"2024-09-15T22:57:08.428477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409673+0000","last_change":"2024-09-15T22:57:06.419004+0000","last_active":"2024-09-15T22:57:08.409673+0000","last_peered":"2024-09-15T22:57:08.409673+0000","last_clean":"2024-09-15T22:57:08.409673+0000","last_became_active":"2024-09-15T22:57:06.418305+0000","last_became_peered":"2024-09-15T22:57:06.418305+0000","last_unstale":"2024-09-15T22:57:08.409673+0000","last_undegraded":"2024-09-15T22:57:08.409673+0000","last_fullsized":"2024-09-15T22:57:08.409673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:58.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690853+0000","last_change":"2024-09-15T22:57:07.420047+0000","last_active":"2024-09-15T22:57:08.690853+0000","last_peered":"2024-09-15T22:57:08.690853+0000","last_clean":"2024-09-15T22:57:08.690853+0000","last_became_active":"2024-09-15T22:57:07.419680+0000","last_became_peered":"2024-09-15T22:57:07.419680+0000","last_unstale":"2024-09-15T22:57:08.690853+0000","last_undegraded":"2024-09-15T22:57:08.690853+0000","last_fullsized":"2024-09-15T22:57:08.690853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428388+0000","last_change":"2024-09-15T22:57:06.397650+0000","last_active":"2024-09-15T22:57:08.428388+0000","last_peered":"2024-09-15T22:57:08.428388+0000","last_clean":"2024-09-15T22:57:08.428388+0000","last_became_active":"2024-09-15T22:57:06.397149+0000","last_became_peered":"2024-09-15T22:57:06.397149+0000","last_unstale":"2024-09-15T22:57:08.428388+0000","last_undegraded":"2024-09-15T22:57:08.428388+0000","last_fullsized":"2024-09-15T22:57:08.428388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632659+0000","last_change":"2024-09-15T22:57:07.434274+0000","last_active":"2024-09-15T22:57:08.632659+0000","last_peered":"2024-09-15T22:57:08.632659+0000","last_clean":"2024-09-15T22:57:08.632659+0000","last_became_active":"2024-09-15T22:57:07.433581+0000","last_became_peered":"2024-09-15T22:57:07.433581+0000","last_unstale":"2024-09-15T22:57:08.632659+0000","last_undegraded":"2024-09-15T22:57:08.632659+0000","last_fullsized":"2024-09-15T22:57:08.632659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:28.424136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690091+0000","last_change":"2024-09-15T22:57:06.414226+0000","last_active":"2024-09-15T22:57:08.690091+0000","last_peered":"2024-09-15T22:57:08.690091+0000","last_clean":"2024-09-15T22:57:08.690091+0000","last_became_active":"2024-09-15T22:57:06.413884+0000","last_became_peered":"2024-09-15T22:57:06.413884+0000","last_unstale":"2024-09-15T22:57:08.690091+0000","last_undegraded":"2024-09-15T22:57:08.690091+0000","last_fullsized":"2024-09-15T22:57:08.690091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.541726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688260+0000","last_change":"2024-09-15T22:57:07.410462+0000","last_active":"2024-09-15T22:57:08.688260+0000","last_peered":"2024-09-15T22:57:08.688260+0000","last_clean":"2024-09-15T22:57:08.688260+0000","last_became_active":"2024-09-15T22:57:07.409146+0000","last_became_peered":"2024-09-15T22:57:07.409146+0000","last_unstale":"2024-09-15T22:57:08.688260+0000","last_undegraded":"2024-09-15T22:57:08.688260+0000","last_fullsized":"2024-09-15T22:57:08.688260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.835015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688862+0000","last_change":"2024-09-15T22:57:06.396109+0000","last_active":"2024-09-15T22:57:08.688862+0000","last_peered":"2024-09-15T22:57:08.688862+0000","last_clean":"2024-09-15T22:57:08.688862+0000","last_became_active":"2024-09-15T22:57:06.395817+0000","last_became_peered":"2024-09-15T22:57:06.395817+0000","last_unstale":"2024-09-15T22:57:08.688862+0000","last_undegraded":"2024-09-15T22:57:08.688862+0000","last_fullsized":"2024-09-15T22:57:08.688862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:16.048300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409208+0000","last_change":"2024-09-15T22:57:07.402992+0000","last_active":"2024-09-15T22:57:08.409208+0000","last_peered":"2024-09-15T22:57:08.409208+0000","last_clean":"2024-09-15T22:57:08.409208+0000","last_became_active":"2024-09-15T22:57:07.402275+0000","last_became_peered":"2024-09-15T22:57:07.402275+0000","last_unstale":"2024-09-15T22:57:08.409208+0000","last_undegraded":"2024-09-15T22:57:08.409208+0000","last_fullsized":"2024-09-15T22:57:08.409208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429096+0000","last_change":"2024-09-15T22:57:06.399079+0000","last_active":"2024-09-15T22:57:08.429096+0000","last_peered":"2024-09-15T22:57:08.429096+0000","last_clean":"2024-09-15T22:57:08.429096+0000","last_became_active":"2024-09-15T22:57:06.398592+0000","last_became_peered":"2024-09-15T22:57:06.398592+0000","last_unstale":"2024-09-15T22:57:08.429096+0000","last_undegraded":"2024-09-15T22:57:08.429096+0000","last_fullsized":"2024-09-15T22:57:08.429096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408814+0000","last_change":"2024-09-15T22:57:07.392962+0000","last_active":"2024-09-15T22:57:08.408814+0000","last_peered":"2024-09-15T22:57:08.408814+0000","last_clean":"2024-09-15T22:57:08.408814+0000","last_became_active":"2024-09-15T22:57:07.392136+0000","last_became_peered":"2024-09-15T22:57:07.392136+0000","last_unstale":"2024-09-15T22:57:08.408814+0000","last_undegraded":"2024-09-15T22:57:08.408814+0000","last_fullsized":"2024-09-15T22:57:08.408814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:20.488938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409439+0000","last_change":"2024-09-15T22:57:06.403454+0000","last_active":"2024-09-15T22:57:08.409439+0000","last_peered":"2024-09-15T22:57:08.409439+0000","last_clean":"2024-09-15T22:57:08.409439+0000","last_became_active":"2024-09-15T22:57:06.402754+0000","last_became_peered":"2024-09-15T22:57:06.402754+0000","last_unstale":"2024-09-15T22:57:08.409439+0000","last_undegraded":"2024-09-15T22:57:08.409439+0000","last_fullsized":"2024-09-15T22:57:08.409439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428445+0000","last_change":"2024-09-15T22:57:07.416567+0000","last_active":"2024-09-15T22:57:08.428445+0000","last_peered":"2024-09-15T22:57:08.428445+0000","last_clean":"2024-09-15T22:57:08.428445+0000","last_became_active":"2024-09-15T22:57:07.416211+0000","last_became_peered":"2024-09-15T22:57:07.416211+0000","last_unstale":"2024-09-15T22:57:08.428445+0000","last_undegraded":"2024-09-15T22:57:08.428445+0000","last_fullsized":"2024-09-15T22:57:08.428445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:47.557595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409205+0000","last_change":"2024-09-15T22:57:06.392051+0000","last_active":"2024-09-15T22:57:08.409205+0000","last_peered":"2024-09-15T22:57:08.409205+0000","last_clean":"2024-09-15T22:57:08.409205+0000","last_became_active":"2024-09-15T22:57:06.391291+0000","last_became_peered":"2024-09-15T22:57:06.391291+0000","last_unstale":"2024-09-15T22:57:08.409205+0000","last_undegraded":"2024-09-15T22:57:08.409205+0000","last_fullsized":"2024-09-15T22:57:08.409205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689677+0000","last_change":"2024-09-15T22:57:07.404167+0000","last_active":"2024-09-15T22:57:08.689677+0000","last_peered":"2024-09-15T22:57:08.689677+0000","last_clean":"2024-09-15T22:57:08.689677+0000","last_became_active":"2024-09-15T22:57:07.403777+0000","last_became_peered":"2024-09-15T22:57:07.403777+0000","last_unstale":"2024-09-15T22:57:08.689677+0000","last_undegraded":"2024-09-15T22:57:08.689677+0000","last_fullsized":"2024-09-15T22:57:08.689677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:48.121142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409721+0000","last_change":"2024-09-15T22:57:06.401089+0000","last_active":"2024-09-15T22:57:08.409721+0000","last_peered":"2024-09-15T22:57:08.409721+0000","last_clean":"2024-09-15T22:57:08.409721+0000","last_became_active":"2024-09-15T22:57:06.394169+0000","last_became_peered":"2024-09-15T22:57:06.394169+0000","last_unstale":"2024-09-15T22:57:08.409721+0000","last_undegraded":"2024-09-15T22:57:08.409721+0000","last_fullsized":"2024-09-15T22:57:08.409721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689807+0000","last_change":"2024-09-15T22:57:07.402811+0000","last_active":"2024-09-15T22:57:08.689807+0000","last_peered":"2024-09-15T22:57:08.689807+0000","last_clean":"2024-09-15T22:57:08.689807+0000","last_became_active":"2024-09-15T22:57:07.401817+0000","last_became_peered":"2024-09-15T22:57:07.401817+0000","last_unstale":"2024-09-15T22:57:08.689807+0000","last_undegraded":"2024-09-15T22:57:08.689807+0000","last_fullsized":"2024-09-15T22:57:08.689807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:15.684506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406524+0000","last_change":"2024-09-15T22:57:06.391113+0000","last_active":"2024-09-15T22:57:08.406524+0000","last_peered":"2024-09-15T22:57:08.406524+0000","last_clean":"2024-09-15T22:57:08.406524+0000","last_became_active":"2024-09-15T22:57:06.390708+0000","last_became_peered":"2024-09-15T22:57:06.390708+0000","last_unstale":"2024-09-15T22:57:08.406524+0000","last_undegraded":"2024-09-15T22:57:08.406524+0000","last_fullsized":"2024-09-15T22:57:08.406524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.690203+0000","last_change":"2024-09-15T22:57:07.415492+0000","last_active":"2024-09-15T22:57:08.690203+0000","last_peered":"2024-09-15T22:57:08.690203+0000","last_clean":"2024-09-15T22:57:08.690203+0000","last_became_active":"2024-09-15T22:57:07.415101+0000","last_became_peered":"2024-09-15T22:57:07.415101+0000","last_unstale":"2024-09-15T22:57:08.690203+0000","last_undegraded":"2024-09-15T22:57:08.690203+0000","last_fullsized":"2024-09-15T22:57:08.690203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:12.051194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688138+0000","last_change":"2024-09-15T22:57:06.410239+0000","last_active":"2024-09-15T22:57:08.688138+0000","last_peered":"2024-09-15T22:57:08.688138+0000","last_clean":"2024-09-15T22:57:08.688138+0000","last_became_active":"2024-09-15T22:57:06.408665+0000","last_became_peered":"2024-09-15T22:57:06.408665+0000","last_unstale":"2024-09-15T22:57:08.688138+0000","last_undegraded":"2024-09-15T22:57:08.688138+0000","last_fullsized":"2024-09-15T22:57:08.688138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:14.675599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689271+0000","last_change":"2024-09-15T22:57:07.412078+0000","last_active":"2024-09-15T22:57:08.689271+0000","last_peered":"2024-09-15T22:57:08.689271+0000","last_clean":"2024-09-15T22:57:08.689271+0000","last_became_active":"2024-09-15T22:57:07.411701+0000","last_became_peered":"2024-09-15T22:57:07.411701+0000","last_unstale":"2024-09-15T22:57:08.689271+0000","last_undegraded":"2024-09-15T22:57:08.689271+0000","last_fullsized":"2024-09-15T22:57:08.689271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:15.244770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.410091+0000","last_change":"2024-09-15T22:57:06.399953+0000","last_active":"2024-09-15T22:57:08.410091+0000","last_peered":"2024-09-15T22:57:08.410091+0000","last_clean":"2024-09-15T22:57:08.410091+0000","last_became_active":"2024-09-15T22:57:06.398273+0000","last_became_peered":"2024-09-15T22:57:06.398273+0000","last_unstale":"2024-09-15T22:57:08.410091+0000","last_undegraded":"2024-09-15T22:57:08.410091+0000","last_fullsized":"2024-09-15T22:57:08.410091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:14.235863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.631880+0000","last_change":"2024-09-15T22:57:07.434347+0000","last_active":"2024-09-15T22:57:08.631880+0000","last_peered":"2024-09-15T22:57:08.631880+0000","last_clean":"2024-09-15T22:57:08.631880+0000","last_became_active":"2024-09-15T22:57:07.433210+0000","last_became_peered":"2024-09-15T22:57:07.433210+0000","last_unstale":"2024-09-15T22:57:08.631880+0000","last_undegraded":"2024-09-15T22:57:08.631880+0000","last_fullsized":"2024-09-15T22:57:08.631880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:12.060886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.407147+0000","last_change":"2024-09-15T22:57:06.416531+0000","last_active":"2024-09-15T22:57:08.407147+0000","last_peered":"2024-09-15T22:57:08.407147+0000","last_clean":"2024-09-15T22:57:08.407147+0000","last_became_active":"2024-09-15T22:57:06.415794+0000","last_became_peered":"2024-09-15T22:57:06.415794+0000","last_unstale":"2024-09-15T22:57:08.407147+0000","last_undegraded":"2024-09-15T22:57:08.407147+0000","last_fullsized":"2024-09-15T22:57:08.407147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:01.826108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689263+0000","last_change":"2024-09-15T22:57:07.404294+0000","last_active":"2024-09-15T22:57:08.689263+0000","last_peered":"2024-09-15T22:57:08.689263+0000","last_clean":"2024-09-15T22:57:08.689263+0000","last_became_active":"2024-09-15T22:57:07.403987+0000","last_became_peered":"2024-09-15T22:57:07.403987+0000","last_unstale":"2024-09-15T22:57:08.689263+0000","last_undegraded":"2024-09-15T22:57:08.689263+0000","last_fullsized":"2024-09-15T22:57:08.689263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:12.816887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.429123+0000","last_change":"2024-09-15T22:57:06.409400+0000","last_active":"2024-09-15T22:57:08.429123+0000","last_peered":"2024-09-15T22:57:08.429123+0000","last_clean":"2024-09-15T22:57:08.429123+0000","last_became_active":"2024-09-15T22:57:06.409087+0000","last_became_peered":"2024-09-15T22:57:06.409087+0000","last_unstale":"2024-09-15T22:57:08.429123+0000","last_undegraded":"2024-09-15T22:57:08.429123+0000","last_fullsized":"2024-09-15T22:57:08.429123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.042287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409189+0000","last_change":"2024-09-15T22:57:07.412280+0000","last_active":"2024-09-15T22:57:08.409189+0000","last_peered":"2024-09-15T22:57:08.409189+0000","last_clean":"2024-09-15T22:57:08.409189+0000","last_became_active":"2024-09-15T22:57:07.410996+0000","last_became_peered":"2024-09-15T22:57:07.410996+0000","last_unstale":"2024-09-15T22:57:08.409189+0000","last_undegraded":"2024-09-15T22:57:08.409189+0000","last_fullsized":"2024-09-15T22:57:08.409189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:52.714775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.426761+0000","last_change":"2024-09-15T22:57:06.392231+0000","last_active":"2024-09-15T22:57:08.426761+0000","last_peered":"2024-09-15T22:57:08.426761+0000","last_clean":"2024-09-15T22:57:08.426761+0000","last_became_active":"2024-09-15T22:57:06.391825+0000","last_became_peered":"2024-09-15T22:57:06.391825+0000","last_unstale":"2024-09-15T22:57:08.426761+0000","last_undegraded":"2024-09-15T22:57:08.426761+0000","last_fullsized":"2024-09-15T22:57:08.426761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:39.096197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406616+0000","last_change":"2024-09-15T22:57:07.419511+0000","last_active":"2024-09-15T22:57:08.406616+0000","last_peered":"2024-09-15T22:57:08.406616+0000","last_clean":"2024-09-15T22:57:08.406616+0000","last_became_active":"2024-09-15T22:57:07.419226+0000","last_became_peered":"2024-09-15T22:57:07.419226+0000","last_unstale":"2024-09-15T22:57:08.406616+0000","last_undegraded":"2024-09-15T22:57:08.406616+0000","last_fullsized":"2024-09-15T22:57:08.406616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428677+0000","last_change":"2024-09-15T22:57:06.389493+0000","last_active":"2024-09-15T22:57:08.428677+0000","last_peered":"2024-09-15T22:57:08.428677+0000","last_clean":"2024-09-15T22:57:08.428677+0000","last_became_active":"2024-09-15T22:57:06.389159+0000","last_became_peered":"2024-09-15T22:57:06.389159+0000","last_unstale":"2024-09-15T22:57:08.428677+0000","last_undegraded":"2024-09-15T22:57:08.428677+0000","last_fullsized":"2024-09-15T22:57:08.428677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:16.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.687979+0000","last_change":"2024-09-15T22:57:07.414543+0000","last_active":"2024-09-15T22:57:08.687979+0000","last_peered":"2024-09-15T22:57:08.687979+0000","last_clean":"2024-09-15T22:57:08.687979+0000","last_became_active":"2024-09-15T22:57:07.413850+0000","last_became_peered":"2024-09-15T22:57:07.413850+0000","last_unstale":"2024-09-15T22:57:08.687979+0000","last_undegraded":"2024-09-15T22:57:08.687979+0000","last_fullsized":"2024-09-15T22:57:08.687979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:43.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406669+0000","last_change":"2024-09-15T22:57:06.399871+0000","last_active":"2024-09-15T22:57:08.406669+0000","last_peered":"2024-09-15T22:57:08.406669+0000","last_clean":"2024-09-15T22:57:08.406669+0000","last_became_active":"2024-09-15T22:57:06.399238+0000","last_became_peered":"2024-09-15T22:57:06.399238+0000","last_unstale":"2024-09-15T22:57:08.406669+0000","last_undegraded":"2024-09-15T22:57:08.406669+0000","last_fullsized":"2024-09-15T22:57:08.406669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:31.348271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.406470+0000","last_change":"2024-09-15T22:57:07.412429+0000","last_active":"2024-09-15T22:57:08.406470+0000","last_peered":"2024-09-15T22:57:08.406470+0000","last_clean":"2024-09-15T22:57:08.406470+0000","last_became_active":"2024-09-15T22:57:07.412103+0000","last_became_peered":"2024-09-15T22:57:07.412103+0000","last_unstale":"2024-09-15T22:57:08.406470+0000","last_undegraded":"2024-09-15T22:57:08.406470+0000","last_fullsized":"2024-09-15T22:57:08.406470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:51.747678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.428622+0000","last_change":"2024-09-15T22:57:06.409462+0000","last_active":"2024-09-15T22:57:08.428622+0000","last_peered":"2024-09-15T22:57:08.428622+0000","last_clean":"2024-09-15T22:57:08.428622+0000","last_became_active":"2024-09-15T22:57:06.408985+0000","last_became_peered":"2024-09-15T22:57:06.408985+0000","last_unstale":"2024-09-15T22:57:08.428622+0000","last_undegraded":"2024-09-15T22:57:08.428622+0000","last_fullsized":"2024-09-15T22:57:08.428622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:47.661164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688853+0000","last_change":"2024-09-15T22:57:07.411144+0000","last_active":"2024-09-15T22:57:08.688853+0000","last_peered":"2024-09-15T22:57:08.688853+0000","last_clean":"2024-09-15T22:57:08.688853+0000","last_became_active":"2024-09-15T22:57:07.410852+0000","last_became_peered":"2024-09-15T22:57:07.410852+0000","last_unstale":"2024-09-15T22:57:08.688853+0000","last_undegraded":"2024-09-15T22:57:08.688853+0000","last_fullsized":"2024-09-15T22:57:08.688853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.409437+0000","last_change":"2024-09-15T22:57:06.400623+0000","last_active":"2024-09-15T22:57:08.409437+0000","last_peered":"2024-09-15T22:57:08.409437+0000","last_clean":"2024-09-15T22:57:08.409437+0000","last_became_active":"2024-09-15T22:57:06.399225+0000","last_became_peered":"2024-09-15T22:57:06.399225+0000","last_unstale":"2024-09-15T22:57:08.409437+0000","last_undegraded":"2024-09-15T22:57:08.409437+0000","last_fullsized":"2024-09-15T22:57:08.409437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:47.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.408611+0000","last_change":"2024-09-15T22:57:07.421477+0000","last_active":"2024-09-15T22:57:08.408611+0000","last_peered":"2024-09-15T22:57:08.408611+0000","last_clean":"2024-09-15T22:57:08.408611+0000","last_became_active":"2024-09-15T22:57:07.420757+0000","last_became_peered":"2024-09-15T22:57:07.420757+0000","last_unstale":"2024-09-15T22:57:08.408611+0000","last_undegraded":"2024-09-15T22:57:08.408611+0000","last_fullsized":"2024-09-15T22:57:08.408611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:57.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.689138+0000","last_change":"2024-09-15T22:57:06.415777+0000","last_active":"2024-09-15T22:57:08.689138+0000","last_peered":"2024-09-15T22:57:08.689138+0000","last_clean":"2024-09-15T22:57:08.689138+0000","last_became_active":"2024-09-15T22:57:06.415336+0000","last_became_peered":"2024-09-15T22:57:06.415336+0000","last_unstale":"2024-09-15T22:57:08.689138+0000","last_undegraded":"2024-09-15T22:57:08.689138+0000","last_fullsized":"2024-09-15T22:57:08.689138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:04.386363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632259+0000","last_change":"2024-09-15T22:57:07.432549+0000","last_active":"2024-09-15T22:57:08.632259+0000","last_peered":"2024-09-15T22:57:08.632259+0000","last_clean":"2024-09-15T22:57:08.632259+0000","last_became_active":"2024-09-15T22:57:07.431846+0000","last_became_peered":"2024-09-15T22:57:07.431846+0000","last_unstale":"2024-09-15T22:57:08.632259+0000","last_undegraded":"2024-09-15T22:57:08.632259+0000","last_fullsized":"2024-09-15T22:57:08.632259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:06.364764+0000","last_clean_scrub_stamp":"2024-09-15T22:57:06.364764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:38.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.688106+0000","last_change":"2024-09-15T22:57:06.412303+0000","last_active":"2024-09-15T22:57:08.688106+0000","last_peered":"2024-09-15T22:57:08.688106+0000","last_clean":"2024-09-15T22:57:08.688106+0000","last_became_active":"2024-09-15T22:57:06.411608+0000","last_became_peered":"2024-09-15T22:57:06.411608+0000","last_unstale":"2024-09-15T22:57:08.688106+0000","last_undegraded":"2024-09-15T22:57:08.688106+0000","last_fullsized":"2024-09-15T22:57:08.688106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:05.355857+0000","last_clean_scrub_stamp":"2024-09-15T22:57:05.355857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:39.557643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T22:57:08.632679+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:08.632679+0000","last_peered":"2024-09-15T22:57:08.632679+0000","last_clean":"2024-09-15T22:57:08.632679+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:08.632679+0000","last_undegraded":"2024-09-15T22:57:08.632679+0000","last_fullsized":"2024-09-15T22:57:08.632679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:16.337 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:57:16.338 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:57:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 Processor -- start 2024-09-15T22:57:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 -- start start 2024-09-15T22:57:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4dc0b89a0 0x7fa4dc0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0b74b0 con 0x7fa4dc0b96d0 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0d2a70 con 0x7fa4dc0b69b0 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4e0dab640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa4dc0d2d50 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4da59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa4dc0b96d0 0x7fa4dc0b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56162/0 (socket says 172.21.15.28:56162) 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4da59c640 1 -- 172.21.15.28:0/1684721390 learned_addr learned my addr 172.21.15.28:0/1684721390 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4dad9d640 1 --2- 172.21.15.28:0/1684721390 >> v2:172.21.15.28:3300/0 conn(0x7fa4dc0b89a0 0x7fa4dc0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4dad9d640 1 -- 172.21.15.28:0/1684721390 >> v1:172.21.15.131:6789/0 conn(0x7fa4dc0b69b0 legacy=0x7fa4dc161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4dad9d640 1 -- 172.21.15.28:0/1684721390 >> v1:172.21.15.28:6789/0 conn(0x7fa4dc0b96d0 legacy=0x7fa4dc0b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.514+0000 7fa4dad9d640 1 -- 172.21.15.28:0/1684721390 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0d3030 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4dad9d640 1 --2- 172.21.15.28:0/1684721390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0d2490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40097c0 tx=0x7fa4d401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea80b3a2a523d726 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4d959a640 1 -- 172.21.15.28:0/1684721390 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40b0070 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4d959a640 1 -- 172.21.15.28:0/1684721390 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40ab600 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4d959a640 1 -- 172.21.15.28:0/1684721390 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40a4e60 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- 172.21.15.28:0/1684721390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 msgr2=0x7fa4dc0d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/1684721390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0d2490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40097c0 tx=0x7fa4d401c3d0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- 172.21.15.28:0/1684721390 shutdown_connections 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/1684721390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0d2490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- 172.21.15.28:0/1684721390 >> 172.21.15.28:0/1684721390 conn(0x7fa4dc0d1330 msgr2=0x7fa4dc0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- 172.21.15.28:0/1684721390 shutdown_connections 2024-09-15T22:57:16.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- 172.21.15.28:0/1684721390 wait complete. 2024-09-15T22:57:16.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 Processor -- start 2024-09-15T22:57:16.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.518+0000 7fa4e0dab640 1 -- start start 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4dc0b69b0 0x7fa4dc14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4dc0b96d0 0x7fa4dc06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc16c2f0 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc16c170 con 0x7fa4dc0b96d0 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc16c470 con 0x7fa4dc0b69b0 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40310/0 (socket says 172.21.15.28:40310) 2024-09-15T22:57:16.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 -- 172.21.15.28:0/308724426 learned_addr learned my addr 172.21.15.28:0/308724426 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4dad9d640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4dc0b96d0 0x7fa4dc06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4da59c640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4dc0b69b0 0x7fa4dc14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 -- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4dc0b69b0 msgr2=0x7fa4dc14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4dc0b69b0 0x7fa4dc14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 -- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4dc0b96d0 msgr2=0x7fa4dc06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4dc0b96d0 0x7fa4dc06bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 -- 172.21.15.28:0/308724426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0cca80 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d9d9b640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c480 tx=0x7fa4c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4012830 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc0ccd60 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4012c30 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc0cd320 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc0d2490 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4c401c460 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 0x7fa4bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c4085ac0 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.522+0000 7fa4da59c640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 0x7fa4bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.526+0000 7fa4da59c640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 0x7fa4bc069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc1fae00 tx=0x7fa4cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.530+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4c40565f0 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.750+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa4dc15a720 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.754+0000 7fa4d2ffd640 1 -- 172.21.15.28:0/308724426 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fa4c4085e20 con 0x7fa4dc0b89a0 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:57:16.757 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:57:16.758 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:57:16.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 msgr2=0x7fa4bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 0x7fa4bc069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc1fae00 tx=0x7fa4cc009040 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 msgr2=0x7fa4dc0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c480 tx=0x7fa4c400c940 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 shutdown_connections 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa4bc0678c0 0x7fa4bc069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4dc0b96d0 0x7fa4dc06bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4dc0b89a0 0x7fa4dc0cdb20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 --2- 172.21.15.28:0/308724426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4dc0b69b0 0x7fa4dc14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 >> 172.21.15.28:0/308724426 conn(0x7fa4dc0d1330 msgr2=0x7fa4dc0b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 shutdown_connections 2024-09-15T22:57:16.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.758+0000 7fa4e0dab640 1 -- 172.21.15.28:0/308724426 wait complete. 2024-09-15T22:57:16.777 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:16.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.898+0000 7fb991816640 1 Processor -- start 2024-09-15T22:57:16.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb991816640 1 -- start start 2024-09-15T22:57:16.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb991816640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb98c0d33f0 0x7fb98c0d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb991816640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98c0d2be0 con 0x7fb98c161ea0 2024-09-15T22:57:16.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb991816640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98c06e150 con 0x7fb98c06bff0 2024-09-15T22:57:16.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb991816640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb98c06e710 con 0x7fb98c0d33f0 2024-09-15T22:57:16.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb98c161ea0 0x7fb98c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56172/0 (socket says 172.21.15.28:56172) 2024-09-15T22:57:16.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98affd640 1 -- 172.21.15.28:0/970272226 learned_addr learned my addr 172.21.15.28:0/970272226 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:16.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98a7fc640 1 --2- 172.21.15.28:0/970272226 >> v2:172.21.15.131:3300/0 conn(0x7fb98c0d33f0 0x7fb98c0d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054575995 0 0) 0x7fb98c0d2be0 con 0x7fb98c161ea0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb974003530 con 0x7fb98c161ea0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 895864804 0 0) 0x7fb974003530 con 0x7fb98c161ea0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 >> v2:172.21.15.131:3300/0 conn(0x7fb98c0d33f0 msgr2=0x7fb98c0d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 --2- 172.21.15.28:0/970272226 >> v2:172.21.15.131:3300/0 conn(0x7fb98c0d33f0 0x7fb98c0d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 >> v1:172.21.15.131:6789/0 conn(0x7fb98c06bff0 legacy=0x7fb98c0b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c06e430 con 0x7fb98c161ea0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fb97c001680 con 0x7fb98c161ea0 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 >> v1:172.21.15.28:6789/0 conn(0x7fb98c161ea0 legacy=0x7fb98c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740039c0 0x7fb974003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb974004810 0x7fb974004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 0x7fb97400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c06e710 con 0x7fb9740051d0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb97400c070 con 0x7fb9740039c0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb97400c270 con 0x7fb974004810 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 0x7fb97400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98affd640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740039c0 0x7fb974003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98a7fc640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb974004810 0x7fb974004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 -- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb974004810 msgr2=0x7fb974004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb974004810 0x7fb974004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 -- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740039c0 msgr2=0x7fb974003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740039c0 0x7fb974003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98b7fe640 1 -- 172.21.15.28:0/970272226 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb974003530 con 0x7fb9740051d0 2024-09-15T22:57:16.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.902+0000 7fb98affd640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740039c0 0x7fb974003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98b7fe640 1 -- 172.21.15.28:0/970272226 reap_dead start 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 0x7fb97400b9d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e70 tx=0x7fb98401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bef076d63ebb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984001a90 con 0x7fb9740051d0 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984003bc0 con 0x7fb9740051d0 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb989ffb640 1 -- 172.21.15.28:0/970272226 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984005020 con 0x7fb9740051d0 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 msgr2=0x7fb97400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 0x7fb97400b9d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e70 tx=0x7fb98401c780 comp rx=0 tx=0).stop 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- 172.21.15.28:0/970272226 shutdown_connections 2024-09-15T22:57:16.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 --2- 172.21.15.28:0/970272226 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9740051d0 0x7fb97400b9d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- 172.21.15.28:0/970272226 >> 172.21.15.28:0/970272226 conn(0x7fb98c0d1370 msgr2=0x7fb98c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- 172.21.15.28:0/970272226 shutdown_connections 2024-09-15T22:57:16.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- 172.21.15.28:0/970272226 wait complete. 2024-09-15T22:57:16.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 Processor -- start 2024-09-15T22:57:16.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- start start 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 0x7fb98c0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb98c15b340 0x7fb98c0b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c06c460 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c0d3160 con 0x7fb9740051d0 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb991816640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c06c5e0 con 0x7fb98c15b340 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40338/0 (socket says 172.21.15.28:40338) 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98b7fe640 1 -- 172.21.15.28:0/1405280748 learned_addr learned my addr 172.21.15.28:0/1405280748 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98affd640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 0x7fb98c0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.906+0000 7fb98a7fc640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb98c15b340 0x7fb98c0b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 -- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb98c15b340 msgr2=0x7fb98c0b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb98c15b340 0x7fb98c0b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 -- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 msgr2=0x7fb98c0b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 0x7fb98c0b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 -- 172.21.15.28:0/1405280748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c0b75f0 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98affd640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 0x7fb98c0b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98b7fe640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb98401cc60 tx=0x7fb974005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840012e0 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984003980 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c158310 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984006d60 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c0b7890 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c0ced40 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9840a6480 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 0x7fb978069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb98411f6c0 con 0x7fb98c1f7ee0 2024-09-15T22:57:16.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98affd640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 0x7fb978069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.910+0000 7fb98affd640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 0x7fb978069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb97c001210 tx=0x7fb97c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:16.914+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9840b8060 con 0x7fb98c1f7ee0 2024-09-15T22:57:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.110+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb98c0b3c30 con 0x7fb98c1f7ee0 2024-09-15T22:57:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.110+0000 7fb973fff640 1 -- 172.21.15.28:0/1405280748 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fb984016490 con 0x7fb98c1f7ee0 2024-09-15T22:57:17.113 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:17.113 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"btime":"2024-09-15T22:57:10:415033+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:09.788691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2024-09-15T22:57:17.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 msgr2=0x7fb978069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 0x7fb978069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb97c001210 tx=0x7fb97c009040 comp rx=0 tx=0).stop 2024-09-15T22:57:17.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 msgr2=0x7fb98c1f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb98401cc60 tx=0x7fb974005840 comp rx=0 tx=0).stop 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 shutdown_connections 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb98c1f7ee0 0x7fb98c1f8390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb98c15b340 0x7fb98c0b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9780678f0 0x7fb978069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 --2- 172.21.15.28:0/1405280748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9740051d0 0x7fb98c0b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 >> 172.21.15.28:0/1405280748 conn(0x7fb98c0d1370 msgr2=0x7fb98c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 shutdown_connections 2024-09-15T22:57:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.114+0000 7fb991816640 1 -- 172.21.15.28:0/1405280748 wait complete. 2024-09-15T22:57:17.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:57:06.757699+0000', 'modified': '2024-09-15T22:57:09.788691+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4806}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4806': {'gid': 4806, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6835/2539404134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6834', 'nonce': 2539404134}, {'type': 'v1', 'addr': '172.21.15.28:6835', 'nonce': 2539404134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4806, 'qdb_cluster': [4806]} 2024-09-15T22:57:17.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:57:17.534 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:57:17.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 Processor -- start 2024-09-15T22:57:17.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 -- start start 2024-09-15T22:57:17.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe4c80cca90 0x7fe4c815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe4c80b1dc0 0x7fe4c80b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c80b55e0 con 0x7fe4c80b5200 2024-09-15T22:57:17.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c80ce3b0 con 0x7fe4c80cca90 2024-09-15T22:57:17.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.666+0000 7fe4cd34b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c815c5f0 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe4c80cca90 0x7fe4c815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe4c80cca90 0x7fe4c815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40354/0 (socket says 172.21.15.28:40354) 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 -- 172.21.15.28:0/2622694070 learned_addr learned my addr 172.21.15.28:0/2622694070 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/2622694070 >> v2:172.21.15.131:3300/0 conn(0x7fe4c80b1dc0 0x7fe4c80b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 -- 172.21.15.28:0/2622694070 >> v2:172.21.15.131:3300/0 conn(0x7fe4c80b1dc0 msgr2=0x7fe4c80b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 --2- 172.21.15.28:0/2622694070 >> v2:172.21.15.131:3300/0 conn(0x7fe4c80b1dc0 0x7fe4c80b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 -- 172.21.15.28:0/2622694070 >> v1:172.21.15.131:6789/0 conn(0x7fe4c80b5200 legacy=0x7fe4c80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 -- 172.21.15.28:0/2622694070 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c80b2710 con 0x7fe4c80cca90 2024-09-15T22:57:17.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4bffff640 1 --2- 172.21.15.28:0/2622694070 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80cca90 0x7fe4c815c0b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4c806cc00 tx=0x7fe4b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ce742c07238692 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4c67fc640 1 -- 172.21.15.28:0/2622694070 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b2070 con 0x7fe4c80cca90 2024-09-15T22:57:17.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4c67fc640 1 -- 172.21.15.28:0/2622694070 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b00ad680 con 0x7fe4c80cca90 2024-09-15T22:57:17.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4c67fc640 1 -- 172.21.15.28:0/2622694070 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00ada50 con 0x7fe4c80cca90 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 -- 172.21.15.28:0/2622694070 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80cca90 msgr2=0x7fe4c815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/2622694070 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80cca90 0x7fe4c815c0b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4c806cc00 tx=0x7fe4b001c490 comp rx=0 tx=0).stop 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 -- 172.21.15.28:0/2622694070 shutdown_connections 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/2622694070 >> v2:172.21.15.131:3300/0 conn(0x7fe4c80b1dc0 0x7fe4c80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/2622694070 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80cca90 0x7fe4c815c0b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 -- 172.21.15.28:0/2622694070 >> 172.21.15.28:0/2622694070 conn(0x7fe4c806bcc0 msgr2=0x7fe4c806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 -- 172.21.15.28:0/2622694070 shutdown_connections 2024-09-15T22:57:17.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.670+0000 7fe4cd34b640 1 -- 172.21.15.28:0/2622694070 wait complete. 2024-09-15T22:57:17.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 Processor -- start 2024-09-15T22:57:17.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- start start 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 0x7fe4c81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80cca90 0x7fe4c8158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80b3d40 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80cd8c0 con 0x7fe4c80cca90 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c80b3ec0 con 0x7fe4c80b5200 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40362/0 (socket says 172.21.15.28:40362) 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/1104959936 learned_addr learned my addr 172.21.15.28:0/1104959936 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80cca90 0x7fe4c8158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4bffff640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 0x7fe4c81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 msgr2=0x7fe4c81576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 0x7fe4c81576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80cca90 msgr2=0x7fe4c8158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80cca90 0x7fe4c8158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/1104959936 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c815a3b0 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4bffff640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 0x7fe4c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c420 tx=0x7fe4b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4bf7fe640 1 -- 172.21.15.28:0/1104959936 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80052d0 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4bf7fe640 1 -- 172.21.15.28:0/1104959936 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8005470 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c815a690 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4bf7fe640 1 -- 172.21.15.28:0/1104959936 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8007260 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.674+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c815ac50 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bf7fe640 1 -- 172.21.15.28:0/1104959936 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4b8007400 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bf7fe640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 0x7fe4a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bf7fe640 1 -- 172.21.15.28:0/1104959936 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b8085190 con 0x7fe4c80b1dc0 2024-09-15T22:57:17.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bffff640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 0x7fe4a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bffff640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 0x7fe4a8069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00af000 tx=0x7fe4b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 Processor -- start 2024-09-15T22:57:17.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 -- start start 2024-09-15T22:57:17.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786e96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e97440 0x557786e4cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x557786d34b60 con 0x557786e4d290 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557786c9bc70 con 0x557786e97440 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557786c41ed0 con 0x557786e96b20 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40376/0 (socket says 172.21.15.28:40376) 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 -- 172.21.15.28:0/2831747514 learned_addr learned my addr 172.21.15.28:0/2831747514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4bffff640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e97440 0x557786e4cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786e96f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 -- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 msgr2=0x557786e96f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786e96f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 -- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e97440 msgr2=0x557786e4cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e97440 0x557786e4cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 -- 172.21.15.28:0/2831747514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557786c53e50 con 0x557786e4d290 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786e96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.678+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00074c0 tx=0x7fe4c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341d755ea3940192 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bcff9640 1 -- 172.21.15.28:0/2831747514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0019020 con 0x557786e4d290 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bcff9640 1 -- 172.21.15.28:0/2831747514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c0015600 con 0x557786e4d290 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bcff9640 1 -- 172.21.15.28:0/2831747514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00159d0 con 0x557786e4d290 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/2831747514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 msgr2=0x557786e4d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00074c0 tx=0x7fe4c0009750 comp rx=0 tx=0).stop 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/2831747514 shutdown_connections 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e4d290 0x557786e4d670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e97440 0x557786e4cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- 172.21.15.28:0/2831747514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786e96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/2831747514 >> 172.21.15.28:0/2831747514 conn(0x557786e53600 msgr2=0x557786e4b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/2831747514 shutdown_connections 2024-09-15T22:57:17.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/2831747514 wait complete. 2024-09-15T22:57:17.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- start start 2024-09-15T22:57:17.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 Processor -- start 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786e51e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e52390 0x557786e58230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x557786cfdb00 con 0x557786e97440 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557786c76360 con 0x557786e96b20 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557786c732d0 con 0x557786e52390 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 10 client.0 _ll_register_callbacks cb 0x557786e38820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40382/0 (socket says 172.21.15.28:40382) 2024-09-15T22:57:17.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 -- 172.21.15.28:0/3058313930 learned_addr learned my addr 172.21.15.28:0/3058313930 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e52390 0x557786e58230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786e51e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 -- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e52390 msgr2=0x557786e58230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e52390 0x557786e58230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 -- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 msgr2=0x557786e51e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786e51e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 -- 172.21.15.28:0/3058313930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557786c42120 con 0x557786e97440 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786e51e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4bffff640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001c4d0 tx=0x7fe4b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49bf9e0e5f7d906 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b2040 con 0x557786e97440 2024-09-15T22:57:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b00b8920 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4c0015600 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe4b00d0050 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 10 client.4989 fetch_fsmap learned FSMap version 16 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x557786c3b450 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c0015600 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fe4b00d3020 con 0x557786e97440 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 10 client.4989 fetch_fsmap finished waiting for FSMap version 16 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 10 client.4989 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 20 client.4989 populate_metadata read hostname 'smithi028' 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786e9cf50 0x557786e9d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 4 client.4989 mds_command: new command op to 4806 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 --> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557786c35c00 con 0x557786e9cf50 2024-09-15T22:57:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.682+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786e9cf50 0x557786e9d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4a5ffb640 10 client.4989 ms_handle_connect on v2:172.21.15.28:6834/2539404134 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786e9cf50 0x557786e9d330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49f6c0bb25f4b985 server_cookie=775f5650cabc291b in_seq=0 out_seq=0 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/3058313930 <== mds.0 v2:172.21.15.28:6834/2539404134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557786c35c00 con 0x557786e9cf50 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4a5ffb640 10 client.4989 handle_command_reply: tid=0 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 client.4989 shutdown 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 msgr2=0x557786e57cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001c4d0 tx=0x7fe4b00046d0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 shutdown_connections 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786e9cf50 0x557786e9d330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e52390 0x557786e58230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786e57cf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 --2- 172.21.15.28:0/3058313930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786e51e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4a5ffb640 0 client.4989 ms_handle_reset on v2:172.21.15.28:6834/2539404134 2024-09-15T22:57:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 >> 172.21.15.28:0/3058313930 conn(0x557786e4d290 msgr2=0x557786e4bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 shutdown_connections 2024-09-15T22:57:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 1 -- 172.21.15.28:0/3058313930 wait complete. 2024-09-15T22:57:17.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.686+0000 7fe4d0407000 20 client.4989 trim_cache size 0 max 16384 2024-09-15T22:57:17.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 Processor -- start 2024-09-15T22:57:17.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- start start 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e52390 0x557786e96500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786ead010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8200750 con 0x557786e97440 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81f5700 con 0x557786e52390 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c81f5d50 con 0x557786e96b20 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40388/0 (socket says 172.21.15.28:40388) 2024-09-15T22:57:17.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 -- 172.21.15.28:0/4069814533 learned_addr learned my addr 172.21.15.28:0/4069814533 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 -- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 msgr2=0x557786ead010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786ead010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 -- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e52390 msgr2=0x557786e96500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e52390 0x557786e96500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 -- 172.21.15.28:0/4069814533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557786c22fd0 con 0x557786e97440 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0018040 tx=0x7fe4c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5295bdd87f9ad8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4a7fff640 1 -- 172.21.15.28:0/4069814533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0019040 con 0x557786e97440 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4a7fff640 1 -- 172.21.15.28:0/4069814533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c00158c0 con 0x557786e97440 2024-09-15T22:57:17.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4a7fff640 1 -- 172.21.15.28:0/4069814533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0015c90 con 0x557786e97440 2024-09-15T22:57:17.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- 172.21.15.28:0/4069814533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 msgr2=0x557786ead550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0018040 tx=0x7fe4c0015000 comp rx=0 tx=0).stop 2024-09-15T22:57:17.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- 172.21.15.28:0/4069814533 shutdown_connections 2024-09-15T22:57:17.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e97440 0x557786ead550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e96b20 0x557786ead010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- 172.21.15.28:0/4069814533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e52390 0x557786e96500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- 172.21.15.28:0/4069814533 >> 172.21.15.28:0/4069814533 conn(0x557786e4d290 msgr2=0x557786e518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- 172.21.15.28:0/4069814533 shutdown_connections 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- 172.21.15.28:0/4069814533 wait complete. 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- start start 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 Processor -- start 2024-09-15T22:57:17.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786f0a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 0x557786ea07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x557786c9af80 con 0x557786e52390 2024-09-15T22:57:17.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557786c53ca0 con 0x557786e96b20 2024-09-15T22:57:17.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557786ca02a0 con 0x557786e97440 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4d0407000 10 client.0 _ll_register_callbacks cb 0x7fe4b00b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40392/0 (socket says 172.21.15.28:40392) 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.706+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/985850473 learned_addr learned my addr 172.21.15.28:0/985850473 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 0x557786ea07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4bffff640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786f0a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 msgr2=0x557786ea07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 0x557786ea07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 msgr2=0x557786f0a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786f0a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 -- 172.21.15.28:0/985850473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557786d1e750 con 0x557786e52390 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c77fe640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 0x557786ea07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4c6ffd640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80836e0 tx=0x7fe4b8054ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98775c75270a233 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8072060 con 0x557786e52390 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b8051c40 con 0x557786e52390 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4c00158c0 con 0x557786e52390 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe4b8081020 con 0x557786e52390 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 10 client.4995 fetch_fsmap learned FSMap version 16 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x557786c29a30 con 0x557786e52390 2024-09-15T22:57:17.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c00158c0 con 0x557786e52390 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fe4b8083290 con 0x557786e52390 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 10 client.4995 fetch_fsmap finished waiting for FSMap version 16 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 10 client.4995 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 20 client.4995 populate_metadata read hostname 'smithi028' 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786ea0d30 0x557786ea1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 4 client.4995 mds_command: new command op to 4806 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:57:17.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 --> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] -- command(tid 0: {"prefix": "status"}) -- 0x557786ca93a0 con 0x557786ea0d30 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4bffff640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786ea0d30 0x557786ea1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 10 client.4995 ms_handle_connect on v2:172.21.15.28:6834/2539404134 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4bffff640 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786ea0d30 0x557786ea1110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4446310fa7a1232 server_cookie=ddb392fffa24f1e6 in_seq=0 out_seq=0 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 1 -- 172.21.15.28:0/985850473 <== mds.0 v2:172.21.15.28:6834/2539404134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557786ca93a0 con 0x557786ea0d30 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 10 client.4995 handle_command_reply: tid=0 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 client.4995 shutdown 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 msgr2=0x557786f09e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80836e0 tx=0x7fe4b8054ff0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 shutdown_connections 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:6834/2539404134,v1:172.21.15.28:6835/2539404134] conn(0x557786ea0d30 0x557786ea1110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557786e97440 0x557786ea07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557786e96b20 0x557786f0a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4a5ffb640 0 client.4995 ms_handle_reset on v2:172.21.15.28:6834/2539404134 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 --2- 172.21.15.28:0/985850473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557786e52390 0x557786f09e90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 >> 172.21.15.28:0/985850473 conn(0x557786e4d290 msgr2=0x557786eac000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 shutdown_connections 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 1 -- 172.21.15.28:0/985850473 wait complete. 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4d0407000 20 client.4995 trim_cache size 0 max 16384 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "f44574f1-d935-4d4e-b79e-1e1910665f93", 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-09-15T22:57:17.725 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4806, 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 10.316957246999999, 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 16, 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 31, 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 31, 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 17.241002065 2024-09-15T22:57:17.726 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 msgr2=0x7fe4a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 0x7fe4a8069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00af000 tx=0x7fe4b0008040 comp rx=0 tx=0).stop 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 msgr2=0x7fe4c8160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c420 tx=0x7fe4b800c8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 shutdown_connections 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe4a80678c0 0x7fe4a8069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80cca90 0x7fe4c8158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c80b5200 0x7fe4c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 --2- 172.21.15.28:0/1104959936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4c80b1dc0 0x7fe4c8160770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 >> 172.21.15.28:0/1104959936 conn(0x7fe4c806bcc0 msgr2=0x7fe4c80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 shutdown_connections 2024-09-15T22:57:17.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.710+0000 7fe4cd34b640 1 -- 172.21.15.28:0/1104959936 wait complete. 2024-09-15T22:57:17.729 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:57:17.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 Processor -- start 2024-09-15T22:57:17.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 -- start start 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6a00b24d0 0x7fe6a00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe6a00d0190 0x7fe6a00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00d0960 con 0x7fe6a0145970 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00d0f20 con 0x7fe6a00b24d0 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a722f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00cd620 con 0x7fe6a00d0190 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6a00b24d0 0x7fe6a00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6a00b24d0 0x7fe6a00cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40394/0 (socket says 172.21.15.28:40394) 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 -- 172.21.15.28:0/1273865031 learned_addr learned my addr 172.21.15.28:0/1273865031 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe6a57cc640 1 --2- 172.21.15.28:0/1273865031 >> v2:172.21.15.131:3300/0 conn(0x7fe6a00d0190 0x7fe6a00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 -- 172.21.15.28:0/1273865031 >> v2:172.21.15.131:3300/0 conn(0x7fe6a00d0190 msgr2=0x7fe6a00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 --2- 172.21.15.28:0/1273865031 >> v2:172.21.15.131:3300/0 conn(0x7fe6a00d0190 0x7fe6a00cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 -- 172.21.15.28:0/1273865031 >> v1:172.21.15.131:6789/0 conn(0x7fe6a0145970 legacy=0x7fe6a00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.842+0000 7fe69ffff640 1 -- 172.21.15.28:0/1273865031 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00d0c40 con 0x7fe6a00b24d0 2024-09-15T22:57:17.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe69ffff640 1 --2- 172.21.15.28:0/1273865031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a00cfc50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe6a006cbd0 tx=0x7fe69001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e65c42a3ccd8927 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe69f7fe640 1 -- 172.21.15.28:0/1273865031 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900b0070 con 0x7fe6a00b24d0 2024-09-15T22:57:17.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe69f7fe640 1 -- 172.21.15.28:0/1273865031 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900ab600 con 0x7fe6a00b24d0 2024-09-15T22:57:17.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe69f7fe640 1 -- 172.21.15.28:0/1273865031 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900ab9d0 con 0x7fe6a00b24d0 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- 172.21.15.28:0/1273865031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 msgr2=0x7fe6a00cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- 172.21.15.28:0/1273865031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a00cfc50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe6a006cbd0 tx=0x7fe69001c460 comp rx=0 tx=0).stop 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- 172.21.15.28:0/1273865031 shutdown_connections 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- 172.21.15.28:0/1273865031 >> v2:172.21.15.131:3300/0 conn(0x7fe6a00d0190 0x7fe6a00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- 172.21.15.28:0/1273865031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a00cfc50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- 172.21.15.28:0/1273865031 >> 172.21.15.28:0/1273865031 conn(0x7fe6a006bcc0 msgr2=0x7fe6a006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- 172.21.15.28:0/1273865031 shutdown_connections 2024-09-15T22:57:17.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- 172.21.15.28:0/1273865031 wait complete. 2024-09-15T22:57:17.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 Processor -- start 2024-09-15T22:57:17.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- start start 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6a00d0190 0x7fe6a01664b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6a0145970 0x7fe6a0142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00ce980 con 0x7fe6a00b24d0 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00ce800 con 0x7fe6a0145970 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a722f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a00ceb00 con 0x7fe6a00d0190 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a4fcb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a4fcb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40404/0 (socket says 172.21.15.28:40404) 2024-09-15T22:57:17.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a4fcb640 1 -- 172.21.15.28:0/3062603040 learned_addr learned my addr 172.21.15.28:0/3062603040 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe6a57cc640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6a0145970 0x7fe6a0142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.846+0000 7fe69ffff640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6a00d0190 0x7fe6a01664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 -- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6a00d0190 msgr2=0x7fe6a01664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6a00d0190 0x7fe6a01664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 -- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6a0145970 msgr2=0x7fe6a0142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6a0145970 0x7fe6a0142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 -- 172.21.15.28:0/3062603040 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a0138730 con 0x7fe6a00b24d0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a4fcb640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c370 tx=0x7fe69400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940052d0 con 0x7fe6a00b24d0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe694005470 con 0x7fe6a00b24d0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a0138a10 con 0x7fe6a00b24d0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694007260 con 0x7fe6a00b24d0 2024-09-15T22:57:17.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a01390f0 con 0x7fe6a00b24d0 2024-09-15T22:57:17.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a00cfc50 con 0x7fe6a00b24d0 2024-09-15T22:57:17.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe694007400 con 0x7fe6a00b24d0 2024-09-15T22:57:17.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:17.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe6940850e0 con 0x7fe6a00b24d0 2024-09-15T22:57:17.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69ffff640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:17.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.850+0000 7fe69ffff640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 0x7fe68c069db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ad000 tx=0x7fe6900a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:17.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:17.854+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe694055c20 con 0x7fe6a00b24d0 2024-09-15T22:57:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.050+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe6a0072c80 con 0x7fe6a00b24d0 2024-09-15T22:57:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe69d7fa640 1 -- 172.21.15.28:0/3062603040 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7fe694055520 con 0x7fe6a00b24d0 2024-09-15T22:57:18.054 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 msgr2=0x7fe68c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 0x7fe68c069db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ad000 tx=0x7fe6900a6000 comp rx=0 tx=0).stop 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 msgr2=0x7fe6a015c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c370 tx=0x7fe69400c830 comp rx=0 tx=0).stop 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 shutdown_connections 2024-09-15T22:57:18.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6a0145970 0x7fe6a0142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6a00d0190 0x7fe6a01664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 --2- 172.21.15.28:0/3062603040 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6a00b24d0 0x7fe6a015c000 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 >> 172.21.15.28:0/3062603040 conn(0x7fe6a006bcc0 msgr2=0x7fe6a013f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 shutdown_connections 2024-09-15T22:57:18.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18.054+0000 7fe6a722f640 1 -- 172.21.15.28:0/3062603040 wait complete. 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:57:18.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:18.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.073 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:18.079 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:57:18.080 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:18.081 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:18.082 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:57:18.082 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:18.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.082 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:57:18.132 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:57:18.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.133 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:57:18.183 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:57:18.184 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:57:18.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:57:18.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:18.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.298 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:57:18.346 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:57:18.346 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:57:18.346 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:18.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:57:18.400 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:57:18.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:18.400 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:18.446 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:18.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:18.446 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:18.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:18.552 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:18.599 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:18.600 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:18.601 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:18.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.602 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:18.650 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:57:18.650 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:57:18.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:18.713 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:18.763 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:18.764 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:18.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:18.766 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:18.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:57:18.778+0000 7fb09e0ee580 -1 init, newargv = 0x564332850180 newargc=15 2024-09-15T22:57:18.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37514]: starting ceph client 2024-09-15T22:57:18.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37514]: starting fuse 2024-09-15T22:57:19.887 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:19.903 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:19.951 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:19.951 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:19.951 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:19.952 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:19.953 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:19.954 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:19.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:19.955 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:20.002 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:57:20.003 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:20.003 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:57:20.004 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:57:20.005 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:57:20.005 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:57:20.005 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:20.005 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:57:20.005 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:57:20.134 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.37514.asok 2024-09-15T22:57:20.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:20.148 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37514.asok 2024-09-15T22:57:20.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:20.148 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37514.asok status 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "37514", 2024-09-15T22:57:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5004, 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5004 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:20.306 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 186750822 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 186750822 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5004 192.168.0.1:0/186750822", 2024-09-15T22:57:20.307 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/186750822", 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 16, 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 31, 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:57:20.308 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:20.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:20.318 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:57:20.318 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:20.324 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:57:20.325 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:20.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:20.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:20.376 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-09-15T22:57:20.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.550+0000 7fdf8fc82640 1 Processor -- start 2024-09-15T22:57:20.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.550+0000 7fdf8fc82640 1 -- start start 2024-09-15T22:57:20.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdf8815e5b0 0x7fdf8815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf880730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 0x7fdf880d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fdf88070150 con 0x7fdf8815e5b0 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdf8815faf0 con 0x7fdf88073600 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8fc82640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8815e990 con 0x7fdf88070930 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdf8815e5b0 0x7fdf8815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdf8815e5b0 0x7fdf8815f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40412/0 (socket says 172.21.15.28:40412) 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 -- 172.21.15.28:0/918893079 learned_addr learned my addr 172.21.15.28:0/918893079 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8d21d640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf880730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8e21f640 1 --2- 172.21.15.28:0/918893079 >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 0x7fdf880d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 -- 172.21.15.28:0/918893079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 msgr2=0x7fdf880730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf880730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 -- 172.21.15.28:0/918893079 >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 msgr2=0x7fdf880d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/918893079 >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 0x7fdf880d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 -- 172.21.15.28:0/918893079 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8806f540 con 0x7fdf8815e5b0 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8e21f640 1 --2- 172.21.15.28:0/918893079 >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 0x7fdf880d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:20.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815f5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf880700c0 tx=0x7fdf7c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6040de7e849cb70b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8ca1c640 1 -- 172.21.15.28:0/918893079 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0b0070 con 0x7fdf8815e5b0 2024-09-15T22:57:20.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8ca1c640 1 -- 172.21.15.28:0/918893079 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0ab600 con 0x7fdf8815e5b0 2024-09-15T22:57:20.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.554+0000 7fdf8ca1c640 1 -- 172.21.15.28:0/918893079 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0ab9d0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/918893079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 msgr2=0x7fdf8815f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815f5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf880700c0 tx=0x7fdf7c01c260 comp rx=0 tx=0).stop 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/918893079 shutdown_connections 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/918893079 >> v2:172.21.15.131:3300/0 conn(0x7fdf88073600 0x7fdf880d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf880730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/918893079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815f5b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/918893079 >> 172.21.15.28:0/918893079 conn(0x7fdf880d23d0 msgr2=0x7fdf880d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/918893079 shutdown_connections 2024-09-15T22:57:20.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/918893079 wait complete. 2024-09-15T22:57:20.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 Processor -- start 2024-09-15T22:57:20.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- start start 2024-09-15T22:57:20.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf881595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf88073600 0x7fdf8814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8806d3f0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8806d270 con 0x7fdf88073600 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8806d570 con 0x7fdf88070930 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40416/0 (socket says 172.21.15.28:40416) 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 -- 172.21.15.28:0/1522399643 learned_addr learned my addr 172.21.15.28:0/1522399643 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8d21d640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf88073600 0x7fdf8814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf881595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 -- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 msgr2=0x7fdf881595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf881595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 -- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf88073600 msgr2=0x7fdf8814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf88073600 0x7fdf8814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 -- 172.21.15.28:0/1522399643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8814db40 con 0x7fdf8815e5b0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8e21f640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000cef0 tx=0x7fdf8000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8001a070 con 0x7fdf8815e5b0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8000d860 con 0x7fdf8815e5b0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000dc50 con 0x7fdf8815e5b0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf88159ae0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.558+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8814e0c0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf880d02d0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf8001d070 con 0x7fdf8815e5b0 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf867fc640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdf80086500 con 0x7fdf8815e5b0 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.562+0000 7fdf8da1e640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 0x7fdf6c069db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0ad000 tx=0x7fdf7c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.566+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdf800570f0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.734+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7fdf880d2a60 con 0x7fdf8815e5b0 2024-09-15T22:57:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.954+0000 7fdf867fc640 1 -- 172.21.15.28:0/1522399643 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v32) ==== 124+0+0 (secure 0 0 0) 0x7fdf800569f0 con 0x7fdf8815e5b0 2024-09-15T22:57:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'data_new' created 2024-09-15T22:57:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 msgr2=0x7fdf6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 0x7fdf6c069db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0ad000 tx=0x7fdf7c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:57:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 msgr2=0x7fdf8815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000cef0 tx=0x7fdf8000a710 comp rx=0 tx=0).stop 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 shutdown_connections 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf8815e5b0 0x7fdf8815b260 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdf6c0678f0 0x7fdf6c069db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf88073600 0x7fdf8814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 --2- 172.21.15.28:0/1522399643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf88070930 0x7fdf881595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 >> 172.21.15.28:0/1522399643 conn(0x7fdf880d23d0 msgr2=0x7fdf880b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 shutdown_connections 2024-09-15T22:57:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:20.958+0000 7fdf8fc82640 1 -- 172.21.15.28:0/1522399643 wait complete. 2024-09-15T22:57:20.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-09-15T22:57:21.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.106+0000 7effb2aa9640 1 Processor -- start 2024-09-15T22:57:21.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.106+0000 7effb2aa9640 1 -- start start 2024-09-15T22:57:21.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb2aa9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7effac15e630 0x7effac0d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:21.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb2aa9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac0cf4d0 con 0x7effac0d2710 2024-09-15T22:57:21.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb2aa9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac0cf770 con 0x7effac0d0a70 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb2aa9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7effac0b3e30 con 0x7effac15e630 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb0845640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7effac15e630 0x7effac0d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb1046640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7effac0d2710 0x7effac0b7550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56180/0 (socket says 172.21.15.28:56180) 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb0845640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7effac15e630 0x7effac0d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40426/0 (socket says 172.21.15.28:40426) 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb1046640 1 -- 172.21.15.28:0/4251628480 learned_addr learned my addr 172.21.15.28:0/4251628480 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb0845640 1 -- 172.21.15.28:0/4251628480 >> v1:172.21.15.131:6789/0 conn(0x7effac0d0a70 legacy=0x7effac0b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb0845640 1 -- 172.21.15.28:0/4251628480 >> v1:172.21.15.28:6789/0 conn(0x7effac0d2710 legacy=0x7effac0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:21.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effb0845640 1 -- 172.21.15.28:0/4251628480 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac0cfa50 con 0x7effac15e630 2024-09-15T22:57:21.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.110+0000 7effab7fe640 1 -- 172.21.15.28:0/4251628480 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441999 0 0) 0x7effac0cf4d0 con 0x7effac0d2710 2024-09-15T22:57:21.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 --2- 172.21.15.28:0/4251628480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac15e630 0x7effac0d0530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097c0 tx=0x7eff9c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c070bb7bd089ba15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:21.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effab7fe640 1 -- 172.21.15.28:0/4251628480 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0b1070 con 0x7effac15e630 2024-09-15T22:57:21.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effab7fe640 1 -- 172.21.15.28:0/4251628480 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c0ac600 con 0x7effac15e630 2024-09-15T22:57:21.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effab7fe640 1 -- 172.21.15.28:0/4251628480 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0ac9d0 con 0x7effac15e630 2024-09-15T22:57:21.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- 172.21.15.28:0/4251628480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac15e630 msgr2=0x7effac0d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 --2- 172.21.15.28:0/4251628480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac15e630 0x7effac0d0530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097c0 tx=0x7eff9c01c490 comp rx=0 tx=0).stop 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- 172.21.15.28:0/4251628480 shutdown_connections 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 --2- 172.21.15.28:0/4251628480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac15e630 0x7effac0d0530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- 172.21.15.28:0/4251628480 >> 172.21.15.28:0/4251628480 conn(0x7effac0d4550 msgr2=0x7effac0d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- 172.21.15.28:0/4251628480 shutdown_connections 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- 172.21.15.28:0/4251628480 wait complete. 2024-09-15T22:57:21.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 Processor -- start 2024-09-15T22:57:21.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- start start 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effac15e630 0x7effac150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 0x7effac1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7effac15ea10 con 0x7effac0d2710 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effac0b6af0 con 0x7effac15e630 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb2aa9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7effac154a70 con 0x7effac0cbbe0 2024-09-15T22:57:21.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40428/0 (socket says 172.21.15.28:40428) 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 -- 172.21.15.28:0/370056194 learned_addr learned my addr 172.21.15.28:0/370056194 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effabfff640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effac15e630 0x7effac150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb1046640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 0x7effac1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 -- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 msgr2=0x7effac1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 0x7effac1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 -- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effac15e630 msgr2=0x7effac150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effac15e630 0x7effac150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb0845640 1 -- 172.21.15.28:0/370056194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac154d50 con 0x7effac0d2710 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.114+0000 7effb1046640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 0x7effac1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effb0845640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097c0 tx=0x7eff9c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0b1040 con 0x7effac0d2710 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c0ac400 con 0x7effac0d2710 2024-09-15T22:57:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac155030 con 0x7effac0d2710 2024-09-15T22:57:21.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0b6660 con 0x7effac0d2710 2024-09-15T22:57:21.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac150f70 con 0x7effac0d2710 2024-09-15T22:57:21.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac0d2fc0 con 0x7effac0d2710 2024-09-15T22:57:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff9c0c0030 con 0x7effac0d2710 2024-09-15T22:57:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 0x7eff98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6072+0+0 (secure 0 0 0) 0x7eff9c120920 con 0x7effac0d2710 2024-09-15T22:57:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effabfff640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 0x7eff98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.118+0000 7effabfff640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 0x7eff98069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effac0b32e0 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:21.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.122+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff9c0c7020 con 0x7effac0d2710 2024-09-15T22:57:21.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:21.326+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7effac0b7950 con 0x7effac0d2710 2024-09-15T22:57:22.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.010+0000 7effa97fa640 1 -- 172.21.15.28:0/370056194 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v17) ==== 131+0+0 (secure 0 0 0) 0x7eff9c0160b0 con 0x7effac0d2710 2024-09-15T22:57:22.012 INFO:teuthology.orchestra.run.smithi028.stderr:added data pool 6 to fsmap 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 msgr2=0x7eff98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 0x7eff98069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effac0b32e0 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 msgr2=0x7effac0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097c0 tx=0x7eff9c01acd0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 shutdown_connections 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effac0cbbe0 0x7effac1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7eff980678c0 0x7eff98069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effac15e630 0x7effac150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 --2- 172.21.15.28:0/370056194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effac0d2710 0x7effac0cdf70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 >> 172.21.15.28:0/370056194 conn(0x7effac0d4550 msgr2=0x7effac0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 shutdown_connections 2024-09-15T22:57:22.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.014+0000 7effb2aa9640 1 -- 172.21.15.28:0/370056194 wait complete. 2024-09-15T22:57:22.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 Processor -- start 2024-09-15T22:57:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 -- start start 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 0x7fd1880b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd1880d0360 0x7fd1880cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1880d0960 con 0x7fd1880b2300 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880d0f20 con 0x7fd1880d0360 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18c8b9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880cd620 con 0x7fd188145970 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd1880d0360 0x7fd1880cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd1880d0360 0x7fd1880cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40432/0 (socket says 172.21.15.28:40432) 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 -- 172.21.15.28:0/2441584141 learned_addr learned my addr 172.21.15.28:0/2441584141 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18659c640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 0x7fd1880b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 -- 172.21.15.28:0/2441584141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 msgr2=0x7fd1880b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 0x7fd1880b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 -- 172.21.15.28:0/2441584141 >> v1:172.21.15.131:6789/0 conn(0x7fd1880b2300 legacy=0x7fd1880cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd186d9d640 1 -- 172.21.15.28:0/2441584141 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880d0c40 con 0x7fd1880d0360 2024-09-15T22:57:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.162+0000 7fd18659c640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 0x7fd1880b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd186d9d640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1880d0360 0x7fd1880cdab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd180009e50 tx=0x7fd18001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ea9b5a11509b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18559a640 1 -- 172.21.15.28:0/2441584141 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800a5770 con 0x7fd1880d0360 2024-09-15T22:57:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18559a640 1 -- 172.21.15.28:0/2441584141 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800a5910 con 0x7fd1880d0360 2024-09-15T22:57:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18559a640 1 -- 172.21.15.28:0/2441584141 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800a5ce0 con 0x7fd1880d0360 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- 172.21.15.28:0/2441584141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1880d0360 msgr2=0x7fd1880cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1880d0360 0x7fd1880cdab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd180009e50 tx=0x7fd18001c9a0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- 172.21.15.28:0/2441584141 shutdown_connections 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1880d0360 0x7fd1880cdab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/2441584141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd188145970 0x7fd1880b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- 172.21.15.28:0/2441584141 >> 172.21.15.28:0/2441584141 conn(0x7fd18806bcc0 msgr2=0x7fd18806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- 172.21.15.28:0/2441584141 shutdown_connections 2024-09-15T22:57:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- 172.21.15.28:0/2441584141 wait complete. 2024-09-15T22:57:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 Processor -- start 2024-09-15T22:57:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- start start 2024-09-15T22:57:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1880b2300 0x7fd18815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1880d0360 0x7fd188140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880ceb90 con 0x7fd188145970 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880cea10 con 0x7fd1880b2300 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd18c8b9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880ced10 con 0x7fd1880d0360 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40438/0 (socket says 172.21.15.28:40438) 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.166+0000 7fd186d9d640 1 -- 172.21.15.28:0/33023559 learned_addr learned my addr 172.21.15.28:0/33023559 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18659c640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1880b2300 0x7fd18815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd185d9b640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1880d0360 0x7fd188140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 -- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1880d0360 msgr2=0x7fd188140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1880d0360 0x7fd188140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 -- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1880b2300 msgr2=0x7fd18815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1880b2300 0x7fd18815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 -- 172.21.15.28:0/33023559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18815d3e0 con 0x7fd188145970 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd186d9d640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd1800af040 tx=0x7fd180019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800bc020 con 0x7fd188145970 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800b8670 con 0x7fd188145970 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1881412d0 con 0x7fd188145970 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800b8a40 con 0x7fd188145970 2024-09-15T22:57:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18815d6a0 con 0x7fd188145970 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1880cdab0 con 0x7fd188145970 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1800bf020 con 0x7fd188145970 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 0x7fd168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7fd180120c20 con 0x7fd188145970 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18659c640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 0x7fd168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.170+0000 7fd18659c640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 0x7fd168069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd178006e90 tx=0x7fd178008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.174+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1800c6030 con 0x7fd188145970 2024-09-15T22:57:22.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd188142990 con 0x7fd188145970 2024-09-15T22:57:22.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd17effd640 1 -- 172.21.15.28:0/33023559 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5231 (secure 0 0 0) 0x7fd180016620 con 0x7fd188145970 2024-09-15T22:57:22.375 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:22.375 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"btime":"2024-09-15T22:57:21:976822+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:21.329043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:22.375 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 17 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 msgr2=0x7fd168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 0x7fd168069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd178006e90 tx=0x7fd178008040 comp rx=0 tx=0).stop 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 msgr2=0x7fd188139320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd1800af040 tx=0x7fd180019740 comp rx=0 tx=0).stop 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 shutdown_connections 2024-09-15T22:57:22.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd188145970 0x7fd188139320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1880d0360 0x7fd188140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1680678c0 0x7fd168069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 --2- 172.21.15.28:0/33023559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1880b2300 0x7fd18815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 >> 172.21.15.28:0/33023559 conn(0x7fd18806bcc0 msgr2=0x7fd18806c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 shutdown_connections 2024-09-15T22:57:22.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.374+0000 7fd18c8b9640 1 -- 172.21.15.28:0/33023559 wait complete. 2024-09-15T22:57:22.395 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 Processor -- start 2024-09-15T22:57:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 -- start start 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f981415e820 0x7f98140cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98140d2ba0 con 0x7f981406d870 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f98140d2e80 con 0x7f981415e820 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f981933d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f98140d3160 con 0x7f98140b3610 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98137fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98127fc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f981415e820 0x7f98140cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98137fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:53988/0 (socket says 172.21.15.28:53988) 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98137fe640 1 -- 172.21.15.28:0/311965008 learned_addr learned my addr 172.21.15.28:0/311965008 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98127fc640 1 -- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 msgr2=0x7f98140d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98127fc640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98127fc640 1 -- 172.21.15.28:0/311965008 >> v1:172.21.15.131:6789/0 conn(0x7f981406d870 legacy=0x7f981406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98127fc640 1 -- 172.21.15.28:0/311965008 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140d3440 con 0x7f981415e820 2024-09-15T22:57:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.514+0000 7f98137fe640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f98127fc640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981415e820 0x7f98140cf750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0097c0 tx=0x7f97fc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b2268a1137d5115 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f9811ffb640 1 -- 172.21.15.28:0/311965008 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0ab610 con 0x7f981415e820 2024-09-15T22:57:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f9811ffb640 1 -- 172.21.15.28:0/311965008 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc0b0070 con 0x7f981415e820 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f9811ffb640 1 -- 172.21.15.28:0/311965008 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0ab9d0 con 0x7f981415e820 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 -- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981415e820 msgr2=0x7f98140cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981415e820 0x7f98140cf750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0097c0 tx=0x7f97fc01c470 comp rx=0 tx=0).stop 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 -- 172.21.15.28:0/311965008 shutdown_connections 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98140b3610 0x7f98140d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 --2- 172.21.15.28:0/311965008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981415e820 0x7f98140cf750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 -- 172.21.15.28:0/311965008 >> 172.21.15.28:0/311965008 conn(0x7f98140d4910 msgr2=0x7f98140d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 -- 172.21.15.28:0/311965008 shutdown_connections 2024-09-15T22:57:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.518+0000 7f981933d640 1 -- 172.21.15.28:0/311965008 wait complete. 2024-09-15T22:57:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 Processor -- start 2024-09-15T22:57:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- start start 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981406d870 0x7f98140b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f981415e820 0x7f981415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f981416b530 con 0x7f98140b3610 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f981416b3b0 con 0x7f981406d870 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f981416b6b0 con 0x7f981415e820 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40444/0 (socket says 172.21.15.28:40444) 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 -- 172.21.15.28:0/3351249016 learned_addr learned my addr 172.21.15.28:0/3351249016 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98137fe640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f981415e820 0x7f981415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f9812ffd640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981406d870 0x7f98140b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 -- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f981415e820 msgr2=0x7f981415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f981415e820 0x7f981415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 -- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981406d870 msgr2=0x7f98140b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981406d870 0x7f98140b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 -- 172.21.15.28:0/3351249016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140b5c10 con 0x7f98140b3610 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f98127fc640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01ab20 tx=0x7f97fc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0abbb0 con 0x7f98140b3610 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc0abd50 con 0x7f98140b3610 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98140c9280 con 0x7f98140b3610 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0bf670 con 0x7f98140b3610 2024-09-15T22:57:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98140c87a0 con 0x7f98140b3610 2024-09-15T22:57:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98140d3c40 con 0x7f98140b3610 2024-09-15T22:57:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.522+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97fc0bf810 con 0x7f98140b3610 2024-09-15T22:57:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.526+0000 7f980b7fe640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 0x7f97f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.526+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7f97fc120580 con 0x7f98140b3610 2024-09-15T22:57:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.526+0000 7f9812ffd640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 0x7f97f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.526+0000 7f9812ffd640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 0x7f97f4069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9804001d50 tx=0x7f9804009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.530+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f97fc0a8050 con 0x7f98140b3610 2024-09-15T22:57:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.694+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98140b33f0 con 0x7f98140b3610 2024-09-15T22:57:22.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.698+0000 7f980b7fe640 1 -- 172.21.15.28:0/3351249016 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18590 (secure 0 0 0) 0x7f97fc016090 con 0x7f98140b3610 2024-09-15T22:57:22.701 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:22.701 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":33,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:21.328552+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-15T22:57:20.775343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:22.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 msgr2=0x7f97f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 0x7f97f4069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9804001d50 tx=0x7f9804009040 comp rx=0 tx=0).stop 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 msgr2=0x7f981415d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97fc01ab20 tx=0x7f97fc019210 comp rx=0 tx=0).stop 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 shutdown_connections 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f981415e820 0x7f981415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98140b3610 0x7f981415d730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f97f40678c0 0x7f97f4069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 --2- 172.21.15.28:0/3351249016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f981406d870 0x7f98140b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 >> 172.21.15.28:0/3351249016 conn(0x7f98140d4910 msgr2=0x7f98140d4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 shutdown_connections 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.702+0000 7f981933d640 1 -- 172.21.15.28:0/3351249016 wait complete. 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:22.721 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-09-15T22:57:22.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:22.733 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-09-15T22:57:22.786 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-09-15T22:57:22.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.966+0000 7f5a53047640 1 Processor -- start 2024-09-15T22:57:22.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.966+0000 7f5a53047640 1 -- start start 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a53047640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5a4c0ce480 0x7f5a4c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a53047640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c0cf050 con 0x7f5a4c0b2540 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a53047640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c0cf330 con 0x7f5a4c15b150 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a53047640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c0cce20 con 0x7f5a4c0ce480 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5a4c0b2540 0x7f5a4c072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55144/0 (socket says 172.21.15.28:55144) 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4bfff640 1 -- 172.21.15.28:0/1584936548 learned_addr learned my addr 172.21.15.28:0/1584936548 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a515e4640 1 --2- 172.21.15.28:0/1584936548 >> v2:172.21.15.28:3300/0 conn(0x7f5a4c0ce480 0x7f5a4c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4b7fe640 1 -- 172.21.15.28:0/1584936548 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209187781 0 0) 0x7f5a4c0cf050 con 0x7f5a4c0b2540 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4b7fe640 1 -- 172.21.15.28:0/1584936548 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c005740 con 0x7f5a4c0b2540 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a515e4640 1 -- 172.21.15.28:0/1584936548 >> v1:172.21.15.131:6789/0 conn(0x7f5a4c15b150 legacy=0x7f5a4c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a515e4640 1 -- 172.21.15.28:0/1584936548 >> v1:172.21.15.28:6789/0 conn(0x7f5a4c0b2540 legacy=0x7f5a4c072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a515e4640 1 -- 172.21.15.28:0/1584936548 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c0cf610 con 0x7f5a4c0ce480 2024-09-15T22:57:22.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a515e4640 1 --2- 172.21.15.28:0/1584936548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c0cdc00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009d90 tx=0x7f5a4401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6186f98b42b7ef76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4b7fe640 1 -- 172.21.15.28:0/1584936548 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a440b2070 con 0x7f5a4c0ce480 2024-09-15T22:57:22.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4b7fe640 1 -- 172.21.15.28:0/1584936548 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a440a5970 con 0x7f5a4c0ce480 2024-09-15T22:57:22.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.970+0000 7f5a4b7fe640 1 -- 172.21.15.28:0/1584936548 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a440a5d40 con 0x7f5a4c0ce480 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1584936548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 msgr2=0x7f5a4c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 --2- 172.21.15.28:0/1584936548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c0cdc00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009d90 tx=0x7f5a4401c8b0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1584936548 shutdown_connections 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 --2- 172.21.15.28:0/1584936548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c0cdc00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1584936548 >> 172.21.15.28:0/1584936548 conn(0x7f5a4c067e30 msgr2=0x7f5a4c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1584936548 shutdown_connections 2024-09-15T22:57:22.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1584936548 wait complete. 2024-09-15T22:57:22.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 Processor -- start 2024-09-15T22:57:22.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- start start 2024-09-15T22:57:22.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a4c0b2540 0x7f5a4c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4c15b150 0x7f5a4c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0734c0 con 0x7f5a4c0ce480 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c073340 con 0x7f5a4c15b150 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c073640 con 0x7f5a4c0b2540 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41116/0 (socket says 172.21.15.28:41116) 2024-09-15T22:57:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 -- 172.21.15.28:0/1023473138 learned_addr learned my addr 172.21.15.28:0/1023473138 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a50de3640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a4c0b2540 0x7f5a4c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a515e4640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4c15b150 0x7f5a4c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 -- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a4c0b2540 msgr2=0x7f5a4c1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a4c0b2540 0x7f5a4c1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 -- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4c15b150 msgr2=0x7f5a4c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4c15b150 0x7f5a4c14f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 -- 172.21.15.28:0/1023473138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c151560 con 0x7f5a4c0ce480 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a4bfff640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c420 tx=0x7f5a3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38017070 con 0x7f5a4c0ce480 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a38005cf0 con 0x7f5a4c0ce480 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380072d0 con 0x7f5a4c0ce480 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c151ad0 con 0x7f5a4c0ce480 2024-09-15T22:57:22.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.974+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c152090 con 0x7f5a4c0ce480 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c0cdc00 con 0x7f5a4c0ce480 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a3801a070 con 0x7f5a4c0ce480 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a497fa640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 0x7f5a30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7f5a38085410 con 0x7f5a4c0ce480 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a50de3640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 0x7f5a30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.978+0000 7f5a50de3640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 0x7f5a30069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a40001650 tx=0x7f5a40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:22.982+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a380558e0 con 0x7f5a4c0ce480 2024-09-15T22:57:23.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.214+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f5a4c0cdea0 con 0x7f5a4c0ce480 2024-09-15T22:57:23.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.218+0000 7f5a497fa640 1 -- 172.21.15.28:0/1023473138 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) ==== 210+0+167 (secure 0 0 0) 0x7f5a38059be0 con 0x7f5a4c0ce480 2024-09-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow rw" 2024-09-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:57:23.220 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-09-15T22:57:23.221 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 msgr2=0x7f5a30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 0x7f5a30069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a40001650 tx=0x7f5a40009040 comp rx=0 tx=0).stop 2024-09-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 msgr2=0x7f5a4c148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800c420 tx=0x7f5a3800c8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 shutdown_connections 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a300678f0 0x7f5a30069db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a4c15b150 0x7f5a4c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a4c0ce480 0x7f5a4c148c10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 --2- 172.21.15.28:0/1023473138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a4c0b2540 0x7f5a4c1525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 >> 172.21.15.28:0/1023473138 conn(0x7f5a4c067e30 msgr2=0x7f5a4c159760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 shutdown_connections 2024-09-15T22:57:23.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.222+0000 7f5a53047640 1 -- 172.21.15.28:0/1023473138 wait complete. 2024-09-15T22:57:23.239 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:23.239 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:23.244 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:23.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 Processor -- start 2024-09-15T22:57:23.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 -- start start 2024-09-15T22:57:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1d200b4a30 0x7f1d200d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d200d2e60 con 0x7f1d201587a0 2024-09-15T22:57:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d20162100 con 0x7f1d20162be0 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.406+0000 7f1d2845f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1d201623e0 con 0x7f1d200b4a30 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d261fb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1d201587a0 0x7f1d200b4320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55146/0 (socket says 172.21.15.28:55146) 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d261fb640 1 -- 172.21.15.28:0/2400464084 learned_addr learned my addr 172.21.15.28:0/2400464084 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d259fa640 1 --2- 172.21.15.28:0/2400464084 >> v2:172.21.15.28:3300/0 conn(0x7f1d200b4a30 0x7f1d200d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d251f9640 1 -- 172.21.15.28:0/2400464084 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888871168 0 0) 0x7f1d200d2e60 con 0x7f1d201587a0 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d251f9640 1 -- 172.21.15.28:0/2400464084 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d0c003530 con 0x7f1d201587a0 2024-09-15T22:57:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d259fa640 1 -- 172.21.15.28:0/2400464084 >> v1:172.21.15.131:6789/0 conn(0x7f1d20162be0 legacy=0x7f1d2015e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d259fa640 1 -- 172.21.15.28:0/2400464084 >> v1:172.21.15.28:6789/0 conn(0x7f1d201587a0 legacy=0x7f1d200b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d259fa640 1 -- 172.21.15.28:0/2400464084 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d201626c0 con 0x7f1d200b4a30 2024-09-15T22:57:23.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d259fa640 1 --2- 172.21.15.28:0/2400464084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d200b4a30 0x7f1d200d2230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d100097f0 tx=0x7f1d1001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886d705cf024695e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d251f9640 1 -- 172.21.15.28:0/2400464084 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100b0070 con 0x7f1d200b4a30 2024-09-15T22:57:23.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d251f9640 1 -- 172.21.15.28:0/2400464084 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d100ab600 con 0x7f1d200b4a30 2024-09-15T22:57:23.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d251f9640 1 -- 172.21.15.28:0/2400464084 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100ab9b0 con 0x7f1d200b4a30 2024-09-15T22:57:23.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 -- 172.21.15.28:0/2400464084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d200b4a30 msgr2=0x7f1d200d2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 --2- 172.21.15.28:0/2400464084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d200b4a30 0x7f1d200d2230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d100097f0 tx=0x7f1d1001c380 comp rx=0 tx=0).stop 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 -- 172.21.15.28:0/2400464084 shutdown_connections 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 --2- 172.21.15.28:0/2400464084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d200b4a30 0x7f1d200d2230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 -- 172.21.15.28:0/2400464084 >> 172.21.15.28:0/2400464084 conn(0x7f1d20067bd0 msgr2=0x7f1d20067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 -- 172.21.15.28:0/2400464084 shutdown_connections 2024-09-15T22:57:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.410+0000 7f1d2845f640 1 -- 172.21.15.28:0/2400464084 wait complete. 2024-09-15T22:57:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 Processor -- start 2024-09-15T22:57:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- start start 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d200b4a30 0x7f1d201fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d20162be0 0x7f1d2015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2016c2f0 con 0x7f1d201587a0 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2015f890 con 0x7f1d200b4a30 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2016c470 con 0x7f1d20162be0 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41138/0 (socket says 172.21.15.28:41138) 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 -- 172.21.15.28:0/737037644 learned_addr learned my addr 172.21.15.28:0/737037644 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d261fb640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d200b4a30 0x7f1d201fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d269fc640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d20162be0 0x7f1d2015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 -- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d20162be0 msgr2=0x7f1d2015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d20162be0 0x7f1d2015d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 -- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d200b4a30 msgr2=0x7f1d201fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d200b4a30 0x7f1d201fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 -- 172.21.15.28:0/737037644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d201fc590 con 0x7f1d201587a0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d259fa640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d100097f0 tx=0x7f1d10019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100b9070 con 0x7f1d201587a0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d100abdf0 con 0x7f1d201587a0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100b0040 con 0x7f1d201587a0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d201fc870 con 0x7f1d201587a0 2024-09-15T22:57:23.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.414+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d201fce30 con 0x7f1d201587a0 2024-09-15T22:57:23.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d200d2230 con 0x7f1d201587a0 2024-09-15T22:57:23.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d100bc070 con 0x7f1d201587a0 2024-09-15T22:57:23.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d16ffd640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 0x7f1d04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f1d10120170 con 0x7f1d201587a0 2024-09-15T22:57:23.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d261fb640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 0x7f1d04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.418+0000 7f1d261fb640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 0x7f1d04069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0011f0 tx=0x7f1d1c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.422+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d10016090 con 0x7f1d201587a0 2024-09-15T22:57:23.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.598+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d2006d580 con 0x7f1d201587a0 2024-09-15T22:57:23.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.598+0000 7f1d16ffd640 1 -- 172.21.15.28:0/737037644 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f1d100f0c70 con 0x7f1d201587a0 2024-09-15T22:57:23.601 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 msgr2=0x7f1d04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 0x7f1d04069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0011f0 tx=0x7f1d1c009040 comp rx=0 tx=0).stop 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 msgr2=0x7f1d20163e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d100097f0 tx=0x7f1d10019120 comp rx=0 tx=0).stop 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 shutdown_connections 2024-09-15T22:57:23.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d20162be0 0x7f1d2015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d201587a0 0x7f1d20163e20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d040678c0 0x7f1d04069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 --2- 172.21.15.28:0/737037644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d200b4a30 0x7f1d201fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 >> 172.21.15.28:0/737037644 conn(0x7f1d20067bd0 msgr2=0x7f1d20161030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 shutdown_connections 2024-09-15T22:57:23.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.602+0000 7f1d2845f640 1 -- 172.21.15.28:0/737037644 wait complete. 2024-09-15T22:57:23.620 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:23.621 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:23.626 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.782+0000 7fb332f85640 1 Processor -- start 2024-09-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.782+0000 7fb332f85640 1 -- start start 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb332f85640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb32c145970 0x7fb32c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb332f85640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32c0d0360 0x7fb32c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb332f85640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c0d0960 con 0x7fb32c0b2300 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb332f85640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb32c0b2770 con 0x7fb32c0d0360 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb332f85640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb32c0d0f20 con 0x7fb32c145970 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32c0d0360 0x7fb32c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb32c0b2300 0x7fb32c0cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55150/0 (socket says 172.21.15.28:55150) 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32c0d0360 0x7fb32c0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41144/0 (socket says 172.21.15.28:41144) 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32bfff640 1 -- 172.21.15.28:0/767010684 learned_addr learned my addr 172.21.15.28:0/767010684 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb330d21640 1 --2- 172.21.15.28:0/767010684 >> v2:172.21.15.131:3300/0 conn(0x7fb32c145970 0x7fb32c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 -- 172.21.15.28:0/767010684 >> v2:172.21.15.131:3300/0 conn(0x7fb32c145970 msgr2=0x7fb32c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 --2- 172.21.15.28:0/767010684 >> v2:172.21.15.131:3300/0 conn(0x7fb32c145970 0x7fb32c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 -- 172.21.15.28:0/767010684 >> v1:172.21.15.28:6789/0 conn(0x7fb32c0b2300 legacy=0x7fb32c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 -- 172.21.15.28:0/767010684 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c0d0c40 con 0x7fb32c0d0360 2024-09-15T22:57:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32b7fe640 1 -- 172.21.15.28:0/767010684 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366394606 0 0) 0x7fb32c0d0960 con 0x7fb32c0b2300 2024-09-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb331522640 1 --2- 172.21.15.28:0/767010684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c0d0360 0x7fb32c0cdab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb324009d90 tx=0x7fb32401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2795c43b14dfa45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32b7fe640 1 -- 172.21.15.28:0/767010684 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240b2070 con 0x7fb32c0d0360 2024-09-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32b7fe640 1 -- 172.21.15.28:0/767010684 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3240a5870 con 0x7fb32c0d0360 2024-09-15T22:57:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.786+0000 7fb32b7fe640 1 -- 172.21.15.28:0/767010684 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240a5c40 con 0x7fb32c0d0360 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/767010684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c0d0360 msgr2=0x7fb32c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- 172.21.15.28:0/767010684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c0d0360 0x7fb32c0cdab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb324009d90 tx=0x7fb32401c8a0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/767010684 shutdown_connections 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- 172.21.15.28:0/767010684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c0d0360 0x7fb32c0cdab0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- 172.21.15.28:0/767010684 >> v2:172.21.15.131:3300/0 conn(0x7fb32c145970 0x7fb32c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/767010684 >> 172.21.15.28:0/767010684 conn(0x7fb32c06bcc0 msgr2=0x7fb32c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/767010684 shutdown_connections 2024-09-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/767010684 wait complete. 2024-09-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 Processor -- start 2024-09-15T22:57:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- start start 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32c0b2300 0x7fb32c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c0d0360 0x7fb32c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c0ceb90 con 0x7fb32c145970 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c0cea10 con 0x7fb32c0d0360 2024-09-15T22:57:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c0ced10 con 0x7fb32c0b2300 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41160/0 (socket says 172.21.15.28:41160) 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 -- 172.21.15.28:0/403691770 learned_addr learned my addr 172.21.15.28:0/403691770 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb32bfff640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c0d0360 0x7fb32c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb330d21640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32c0b2300 0x7fb32c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 -- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32c0b2300 msgr2=0x7fb32c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32c0b2300 0x7fb32c15ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 -- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c0d0360 msgr2=0x7fb32c13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c0d0360 0x7fb32c13baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 -- 172.21.15.28:0/403691770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c137b90 con 0x7fb32c145970 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb331522640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb324009d90 tx=0x7fb324019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240bd030 con 0x7fb32c145970 2024-09-15T22:57:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3240b8470 con 0x7fb32c145970 2024-09-15T22:57:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c137e70 con 0x7fb32c145970 2024-09-15T22:57:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3240b2040 con 0x7fb32c145970 2024-09-15T22:57:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.790+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c138430 con 0x7fb32c145970 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c0cdab0 con 0x7fb32c145970 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3240c0070 con 0x7fb32c145970 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb3297fa640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 0x7fb318069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7fb3241206d0 con 0x7fb32c145970 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb330d21640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 0x7fb318069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:23.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.794+0000 7fb330d21640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 0x7fb318069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb32c13d790 tx=0x7fb31c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.798+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb324016520 con 0x7fb32c145970 2024-09-15T22:57:23.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.970+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb32c0aff20 con 0x7fb32c145970 2024-09-15T22:57:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb3297fa640 1 -- 172.21.15.28:0/403691770 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fb3240f1060 con 0x7fb32c145970 2024-09-15T22:57:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 msgr2=0x7fb318069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 0x7fb318069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb32c13d790 tx=0x7fb31c008040 comp rx=0 tx=0).stop 2024-09-15T22:57:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 msgr2=0x7fb32c144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb324009d90 tx=0x7fb324019640 comp rx=0 tx=0).stop 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 shutdown_connections 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32c145970 0x7fb32c144730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb3180678c0 0x7fb318069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c0d0360 0x7fb32c13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 --2- 172.21.15.28:0/403691770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32c0b2300 0x7fb32c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 >> 172.21.15.28:0/403691770 conn(0x7fb32c06bcc0 msgr2=0x7fb32c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 shutdown_connections 2024-09-15T22:57:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:23.974+0000 7fb332f85640 1 -- 172.21.15.28:0/403691770 wait complete. 2024-09-15T22:57:23.993 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:57:23.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:23.993 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:24.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37514]: fuse finished with error 0 and tester_r 0 2024-09-15T22:57:24.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:30.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:57:30.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.108 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:57:30.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:57:30.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.289+0000 7f8cbeaba640 1 Processor -- start 2024-09-15T22:57:30.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.289+0000 7f8cbeaba640 1 -- start start 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbeaba640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cb8145970 0x7f8cb80b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbeaba640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cb80d0360 0x7f8cb80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbeaba640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb80d0960 con 0x7f8cb80b2300 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbeaba640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb80b2770 con 0x7f8cb8145970 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbeaba640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb80d0f20 con 0x7f8cb80d0360 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cb8145970 0x7f8cb80b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cb8145970 0x7f8cb80b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41172/0 (socket says 172.21.15.28:41172) 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 -- 172.21.15.28:0/2254811254 learned_addr learned my addr 172.21.15.28:0/2254811254 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:30.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbd057640 1 --2- 172.21.15.28:0/2254811254 >> v2:172.21.15.131:3300/0 conn(0x7f8cb80d0360 0x7f8cb80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 -- 172.21.15.28:0/2254811254 >> v2:172.21.15.131:3300/0 conn(0x7f8cb80d0360 msgr2=0x7f8cb80cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 --2- 172.21.15.28:0/2254811254 >> v2:172.21.15.131:3300/0 conn(0x7f8cb80d0360 0x7f8cb80cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 -- 172.21.15.28:0/2254811254 >> v1:172.21.15.131:6789/0 conn(0x7f8cb80b2300 legacy=0x7f8cb80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.293+0000 7f8cbc856640 1 -- 172.21.15.28:0/2254811254 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb80d0c40 con 0x7f8cb8145970 2024-09-15T22:57:30.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbc856640 1 --2- 172.21.15.28:0/2254811254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb80b1dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941be8bd182c6119 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cb77fe640 1 -- 172.21.15.28:0/2254811254 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80b1070 con 0x7f8cb8145970 2024-09-15T22:57:30.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cb77fe640 1 -- 172.21.15.28:0/2254811254 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca80ac600 con 0x7f8cb8145970 2024-09-15T22:57:30.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cb77fe640 1 -- 172.21.15.28:0/2254811254 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80ac9d0 con 0x7f8cb8145970 2024-09-15T22:57:30.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 -- 172.21.15.28:0/2254811254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 msgr2=0x7f8cb80b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/2254811254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb80b1dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca801c490 comp rx=0 tx=0).stop 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 -- 172.21.15.28:0/2254811254 shutdown_connections 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/2254811254 >> v2:172.21.15.131:3300/0 conn(0x7f8cb80d0360 0x7f8cb80cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/2254811254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb80b1dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 -- 172.21.15.28:0/2254811254 >> 172.21.15.28:0/2254811254 conn(0x7f8cb806bcc0 msgr2=0x7f8cb806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 -- 172.21.15.28:0/2254811254 shutdown_connections 2024-09-15T22:57:30.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.297+0000 7f8cbeaba640 1 -- 172.21.15.28:0/2254811254 wait complete. 2024-09-15T22:57:30.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 Processor -- start 2024-09-15T22:57:30.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- start start 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb80b2300 0x7f8cb813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb80d0360 0x7f8cb81407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80cebd0 con 0x7f8cb8145970 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80cea50 con 0x7f8cb80d0360 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb80ced50 con 0x7f8cb80b2300 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41182/0 (socket says 172.21.15.28:41182) 2024-09-15T22:57:30.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 -- 172.21.15.28:0/3867276478 learned_addr learned my addr 172.21.15.28:0/3867276478 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbc856640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb80b2300 0x7f8cb813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cb7fff640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb80d0360 0x7f8cb81407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 -- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb80b2300 msgr2=0x7f8cb813d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb80b2300 0x7f8cb813d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 -- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb80d0360 msgr2=0x7f8cb81407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb80d0360 0x7f8cb81407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 -- 172.21.15.28:0/3867276478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb813def0 con 0x7f8cb8145970 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbd057640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007e90 tx=0x7f8cb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0014420 con 0x7f8cb8145970 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb0019070 con 0x7f8cb8145970 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb813e1d0 con 0x7f8cb8145970 2024-09-15T22:57:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0014800 con 0x7f8cb8145970 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb813a410 con 0x7f8cb8145970 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb813a610 con 0x7f8cb8145970 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.301+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cb00149a0 con 0x7f8cb8145970 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.305+0000 7f8cb57fa640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.305+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f8cb0086710 con 0x7f8cb8145970 2024-09-15T22:57:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.305+0000 7f8cbc856640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.305+0000 7f8cbc856640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80ae000 tx=0x7f8ca80a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.309+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cb813a610 con 0x7f8cb8145970 2024-09-15T22:57:30.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.509+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8cb80cda90 con 0x7f8cb8145970 2024-09-15T22:57:30.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.509+0000 7f8cb57fa640 1 -- 172.21.15.28:0/3867276478 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+82 (secure 0 0 0) 0x7f8cb0057020 con 0x7f8cb8145970 2024-09-15T22:57:30.514 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 msgr2=0x7f8ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80ae000 tx=0x7f8ca80a7000 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 msgr2=0x7f8cb815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007e90 tx=0x7f8cb000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 shutdown_connections 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cb8145970 0x7f8cb815a480 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cb80d0360 0x7f8cb81407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 --2- 172.21.15.28:0/3867276478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cb80b2300 0x7f8cb813d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 >> 172.21.15.28:0/3867276478 conn(0x7f8cb806bcc0 msgr2=0x7f8cb80721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 shutdown_connections 2024-09-15T22:57:30.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30.513+0000 7f8cbeaba640 1 -- 172.21.15.28:0/3867276478 wait complete. 2024-09-15T22:57:30.532 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:57:30.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:57:30.533 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.533 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:57:30.539 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:57:30.539 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:57:30.540 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:30.541 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:30.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.542 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:57:30.592 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:57:30.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.593 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:57:30.644 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:57:30.645 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:57:30.645 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:57:30.645 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:57:30.645 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:57:30.645 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:57:30.645 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:57:30.646 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:57:30.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:57:30.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:57:30.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:57:30.646 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:57:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:57:30.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:30.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.769 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:57:30.774 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:57:30.774 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:57:30.774 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:30.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:30.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:57:30.827 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:57:30.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:30.828 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:30.874 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:30.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:30.875 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:30.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:30.980 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:31.027 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:31.027 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:31.027 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:31.028 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:31.029 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:31.030 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:31.030 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:31.030 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:31.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:31.031 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:31.079 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:57:31.079 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:57:31.124 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:31.139 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:31.186 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:31.186 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:31.187 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:31.188 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:31.189 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:31.189 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:31.189 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:31.189 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:31.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:31.190 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:31.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:57:31.205+0000 7ff9c67e8580 -1 init, newargv = 0x5559cb7570c0 newargc=15 2024-09-15T22:57:31.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37819]: starting ceph client 2024-09-15T22:57:31.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37819]: starting fuse 2024-09-15T22:57:32.314 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:32.331 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:32.381 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:32.382 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:32.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.384 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:32.430 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:57:32.431 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:57:32.431 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:57:32.432 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:57:32.433 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:32.433 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:57:32.433 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:57:32.562 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.37819.asok 2024-09-15T22:57:32.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:32.575 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37819.asok 2024-09-15T22:57:32.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37819.asok status 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:57:32.736 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "37819", 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5067, 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5067 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:32.737 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 1485777899 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 1485777899 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:32.738 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5067 192.168.0.1:0/1485777899", 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/1485777899", 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 17, 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 34, 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:57:32.739 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:32.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.750 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:57:32.750 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:32.757 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:57:32.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:32.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:32.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.808 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-09-15T22:57:32.864 INFO:teuthology.orchestra.run.smithi028.stderr:setfattr: layoutfile: Permission denied 2024-09-15T22:57:32.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:32.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:32.865 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-09-15T22:57:32.916 INFO:teuthology.orchestra.run.smithi028.stderr:setfattr: layoutdir: Permission denied 2024-09-15T22:57:32.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:32.918 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:32.918 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:32.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:33.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 Processor -- start 2024-09-15T22:57:33.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 -- start start 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80940b5200 0x7f809415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80940cca90 0x7f80940b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80940b55e0 con 0x7f80940b1dc0 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f80940ce3b0 con 0x7f80940cca90 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f809a7ff640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f809415c5f0 con 0x7f80940b5200 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f80937fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80940cca90 0x7f80940b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f80937fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80940cca90 0x7f80940b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59120/0 (socket says 172.21.15.28:59120) 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.141+0000 7f80937fe640 1 -- 172.21.15.28:0/551082085 learned_addr learned my addr 172.21.15.28:0/551082085 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f8093fff640 1 --2- 172.21.15.28:0/551082085 >> v2:172.21.15.131:3300/0 conn(0x7f80940b5200 0x7f809415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f80937fe640 1 -- 172.21.15.28:0/551082085 >> v2:172.21.15.131:3300/0 conn(0x7f80940b5200 msgr2=0x7f809415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f80937fe640 1 --2- 172.21.15.28:0/551082085 >> v2:172.21.15.131:3300/0 conn(0x7f80940b5200 0x7f809415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f80937fe640 1 -- 172.21.15.28:0/551082085 >> v1:172.21.15.131:6789/0 conn(0x7f80940b1dc0 legacy=0x7f80940b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:33.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f80937fe640 1 -- 172.21.15.28:0/551082085 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80940b4910 con 0x7f80940cca90 2024-09-15T22:57:33.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f80937fe640 1 --2- 172.21.15.28:0/551082085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940cca90 0x7f80940b43d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f809406f1a0 tx=0x7f808801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2851a795705d636 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f8092ffd640 1 -- 172.21.15.28:0/551082085 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b0070 con 0x7f80940cca90 2024-09-15T22:57:33.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f8092ffd640 1 -- 172.21.15.28:0/551082085 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80880ab600 con 0x7f80940cca90 2024-09-15T22:57:33.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f8092ffd640 1 -- 172.21.15.28:0/551082085 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880ab9d0 con 0x7f80940cca90 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 -- 172.21.15.28:0/551082085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940cca90 msgr2=0x7f80940b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 --2- 172.21.15.28:0/551082085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940cca90 0x7f80940b43d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f809406f1a0 tx=0x7f808801c450 comp rx=0 tx=0).stop 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 -- 172.21.15.28:0/551082085 shutdown_connections 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 --2- 172.21.15.28:0/551082085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940cca90 0x7f80940b43d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 --2- 172.21.15.28:0/551082085 >> v2:172.21.15.131:3300/0 conn(0x7f80940b5200 0x7f809415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 -- 172.21.15.28:0/551082085 >> 172.21.15.28:0/551082085 conn(0x7f809406bcc0 msgr2=0x7f809406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 -- 172.21.15.28:0/551082085 shutdown_connections 2024-09-15T22:57:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.145+0000 7f809a7ff640 1 -- 172.21.15.28:0/551082085 wait complete. 2024-09-15T22:57:33.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 Processor -- start 2024-09-15T22:57:33.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- start start 2024-09-15T22:57:33.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b1dc0 0x7f8094158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940cca90 0x7f80940afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f80940b3d40 con 0x7f80940b5200 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f80940cd8c0 con 0x7f80940b1dc0 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f80940b3ec0 con 0x7f80940cca90 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59130/0 (socket says 172.21.15.28:59130) 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 -- 172.21.15.28:0/1271069355 learned_addr learned my addr 172.21.15.28:0/1271069355 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f8093fff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b1dc0 0x7f8094158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f8098d9c640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940cca90 0x7f80940afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 -- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940cca90 msgr2=0x7f80940afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940cca90 0x7f80940afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 -- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b1dc0 msgr2=0x7f8094158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b1dc0 0x7f8094158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 -- 172.21.15.28:0/1271069355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80941554d0 con 0x7f80940b5200 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f80937fe640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f808801ab00 tx=0x7f80880191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b9070 con 0x7f80940b5200 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80880b4420 con 0x7f80940b5200 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80941587a0 con 0x7f80940b5200 2024-09-15T22:57:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b0040 con 0x7f80940b5200 2024-09-15T22:57:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.149+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80941574a0 con 0x7f80940b5200 2024-09-15T22:57:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809415c0b0 con 0x7f80940b5200 2024-09-15T22:57:33.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80880bc070 con 0x7f80940b5200 2024-09-15T22:57:33.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f8090ff9640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 0x7f8080069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f808811ee10 con 0x7f80940b5200 2024-09-15T22:57:33.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f8093fff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 0x7f8080069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.153+0000 7f8093fff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 0x7f8080069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80940b1330 tx=0x7f80840098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.157+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80941554d0 con 0x7f80940b5200 2024-09-15T22:57:33.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8094166010 con 0x7f80940b5200 2024-09-15T22:57:33.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f8090ff9640 1 -- 172.21.15.28:0/1271069355 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f80880160d0 con 0x7f80940b5200 2024-09-15T22:57:33.335 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:33.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 msgr2=0x7f8080069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 0x7f8080069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80940b1330 tx=0x7f80840098d0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 msgr2=0x7f8094152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f808801ab00 tx=0x7f80880191f0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 shutdown_connections 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80940cca90 0x7f80940afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80940b5200 0x7f8094152100 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f80800678c0 0x7f8080069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 --2- 172.21.15.28:0/1271069355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80940b1dc0 0x7f8094158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 >> 172.21.15.28:0/1271069355 conn(0x7f809406bcc0 msgr2=0x7f809406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 shutdown_connections 2024-09-15T22:57:33.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.333+0000 7f809a7ff640 1 -- 172.21.15.28:0/1271069355 wait complete. 2024-09-15T22:57:33.355 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:33.355 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:33.361 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:33.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 Processor -- start 2024-09-15T22:57:33.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 -- start start 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 0x7f62900b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62900b2300 0x7f62900cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62900d0960 con 0x7f62900d0190 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f62900d0f20 con 0x7f62900b2300 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f6295208640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f62900cd620 con 0x7f6290145970 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628ed9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 0x7f62900b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62900b2300 0x7f62900cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628ed9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 0x7f62900b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:37256/0 (socket says 172.21.15.28:37256) 2024-09-15T22:57:33.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628ed9d640 1 -- 172.21.15.28:0/3152194481 learned_addr learned my addr 172.21.15.28:0/3152194481 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628e59c640 1 -- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 msgr2=0x7f62900b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:33.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628e59c640 1 --2- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 0x7f62900b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628e59c640 1 -- 172.21.15.28:0/3152194481 >> v1:172.21.15.131:6789/0 conn(0x7f62900d0190 legacy=0x7f6290072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.521+0000 7f628e59c640 1 -- 172.21.15.28:0/3152194481 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62900d0c40 con 0x7f62900b2300 2024-09-15T22:57:33.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f628e59c640 1 --2- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62900b2300 0x7f62900cfc50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62840097c0 tx=0x7f628401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba4d8c31092a6574 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f628dd9b640 1 -- 172.21.15.28:0/3152194481 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62840b0070 con 0x7f62900b2300 2024-09-15T22:57:33.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f628dd9b640 1 -- 172.21.15.28:0/3152194481 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62840ab600 con 0x7f62900b2300 2024-09-15T22:57:33.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f628dd9b640 1 -- 172.21.15.28:0/3152194481 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62840ab9d0 con 0x7f62900b2300 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 -- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62900b2300 msgr2=0x7f62900cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 --2- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62900b2300 0x7f62900cfc50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62840097c0 tx=0x7f628401c410 comp rx=0 tx=0).stop 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 -- 172.21.15.28:0/3152194481 shutdown_connections 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 --2- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62900b2300 0x7f62900cfc50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 --2- 172.21.15.28:0/3152194481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6290145970 0x7f62900b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 -- 172.21.15.28:0/3152194481 >> 172.21.15.28:0/3152194481 conn(0x7f629006bcc0 msgr2=0x7f629006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 -- 172.21.15.28:0/3152194481 shutdown_connections 2024-09-15T22:57:33.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.525+0000 7f6295208640 1 -- 172.21.15.28:0/3152194481 wait complete. 2024-09-15T22:57:33.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 Processor -- start 2024-09-15T22:57:33.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- start start 2024-09-15T22:57:33.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62900d0190 0x7f6290140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6290145970 0x7f6290144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6290168fe0 con 0x7f62900b2300 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6290168e60 con 0x7f6290145970 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6290169160 con 0x7f62900d0190 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59140/0 (socket says 172.21.15.28:59140) 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 -- 172.21.15.28:0/366349079 learned_addr learned my addr 172.21.15.28:0/366349079 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628e59c640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62900d0190 0x7f6290140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628f59e640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6290145970 0x7f6290144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 -- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62900d0190 msgr2=0x7f6290140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62900d0190 0x7f6290140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 -- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6290145970 msgr2=0x7f6290144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6290145970 0x7f6290144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 -- 172.21.15.28:0/366349079 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62901f8f70 con 0x7f62900b2300 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f628ed9d640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f628000e890 tx=0x7f628000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280017070 con 0x7f62900b2300 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628000c8e0 con 0x7f62900b2300 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62901f9250 con 0x7f62900b2300 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628000ccd0 con 0x7f62900b2300 2024-09-15T22:57:33.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62901f9810 con 0x7f62900b2300 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.529+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62900cfc50 con 0x7f62900b2300 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.533+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f628001a070 con 0x7f62900b2300 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.533+0000 7f62777fe640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 0x7f627c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.533+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f62800860b0 con 0x7f62900b2300 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.533+0000 7f628e59c640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 0x7f627c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.533+0000 7f628e59c640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 0x7f627c069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62840ad000 tx=0x7f6284008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.537+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6280056380 con 0x7f62900b2300 2024-09-15T22:57:33.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f629015c0c0 con 0x7f62900b2300 2024-09-15T22:57:33.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f62777fe640 1 -- 172.21.15.28:0/366349079 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f628005a680 con 0x7f62900b2300 2024-09-15T22:57:33.715 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 msgr2=0x7f627c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 0x7f627c069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f62840ad000 tx=0x7f6284008040 comp rx=0 tx=0).stop 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 msgr2=0x7f629013ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f628000e890 tx=0x7f628000ed50 comp rx=0 tx=0).stop 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 shutdown_connections 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f627c0678f0 0x7f627c069db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6290145970 0x7f6290144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62900d0190 0x7f6290140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 --2- 172.21.15.28:0/366349079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62900b2300 0x7f629013ee80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 >> 172.21.15.28:0/366349079 conn(0x7f629006bcc0 msgr2=0x7f629006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 shutdown_connections 2024-09-15T22:57:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.713+0000 7f6295208640 1 -- 172.21.15.28:0/366349079 wait complete. 2024-09-15T22:57:33.735 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:57:33.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:33.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:33.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[37819]: fuse finished with error 0 and tester_r 0 2024-09-15T22:57:33.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:33.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:57:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:33.797 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:57:33.803 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-09-15T22:57:33.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 Processor -- start 2024-09-15T22:57:33.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 -- start start 2024-09-15T22:57:33.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f246c0d3940 0x7f246c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f246c0b67e0 0x7f246c161130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f246c0b74b0 con 0x7f246c0b67e0 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f246c0d2a70 con 0x7f246c0d3940 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.981+0000 7f2473492640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f246c0d2d50 con 0x7f246c0b96d0 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f246c0b67e0 0x7f246c161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f246c0b67e0 0x7f246c161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59142/0 (socket says 172.21.15.28:59142) 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 -- 172.21.15.28:0/2451070933 learned_addr learned my addr 172.21.15.28:0/2451070933 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2470a2d640 1 --2- 172.21.15.28:0/2451070933 >> v2:172.21.15.131:3300/0 conn(0x7f246c0d3940 0x7f246c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f247122e640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 -- 172.21.15.28:0/2451070933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 msgr2=0x7f246c0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 -- 172.21.15.28:0/2451070933 >> v2:172.21.15.131:3300/0 conn(0x7f246c0d3940 msgr2=0x7f246c0b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:33.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 --2- 172.21.15.28:0/2451070933 >> v2:172.21.15.131:3300/0 conn(0x7f246c0d3940 0x7f246c0b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 -- 172.21.15.28:0/2451070933 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c0d3030 con 0x7f246c0b67e0 2024-09-15T22:57:33.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f247122e640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:33.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2471a2f640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0b67e0 0x7f246c161130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f246c075cf0 tx=0x7f246401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a60cd7b49220552 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2463fff640 1 -- 172.21.15.28:0/2451070933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640b0070 con 0x7f246c0b67e0 2024-09-15T22:57:33.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2463fff640 1 -- 172.21.15.28:0/2451070933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640ab600 con 0x7f246c0b67e0 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2463fff640 1 -- 172.21.15.28:0/2451070933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640ab9d0 con 0x7f246c0b67e0 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 -- 172.21.15.28:0/2451070933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0b67e0 msgr2=0x7f246c161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0b67e0 0x7f246c161130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f246c075cf0 tx=0x7f246401c490 comp rx=0 tx=0).stop 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 -- 172.21.15.28:0/2451070933 shutdown_connections 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0b67e0 0x7f246c161130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 --2- 172.21.15.28:0/2451070933 >> v2:172.21.15.131:3300/0 conn(0x7f246c0d3940 0x7f246c0b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 --2- 172.21.15.28:0/2451070933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 -- 172.21.15.28:0/2451070933 >> 172.21.15.28:0/2451070933 conn(0x7f246c0d1330 msgr2=0x7f246c0d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 -- 172.21.15.28:0/2451070933 shutdown_connections 2024-09-15T22:57:33.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.985+0000 7f2473492640 1 -- 172.21.15.28:0/2451070933 wait complete. 2024-09-15T22:57:33.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 Processor -- start 2024-09-15T22:57:33.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- start start 2024-09-15T22:57:33.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f246c0b67e0 0x7f246c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f246c06c060 con 0x7f246c0d3940 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f246c0cfaf0 con 0x7f246c0b67e0 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f246c06c1e0 con 0x7f246c0b96d0 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59150/0 (socket says 172.21.15.28:59150) 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 -- 172.21.15.28:0/3165114292 learned_addr learned my addr 172.21.15.28:0/3165114292 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2470a2d640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f247122e640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f246c0b67e0 0x7f246c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 -- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 msgr2=0x7f246c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 -- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f246c0b67e0 msgr2=0x7f246c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f246c0b67e0 0x7f246c15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 -- 172.21.15.28:0/3165114292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c0ca440 con 0x7f246c0d3940 2024-09-15T22:57:33.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2471a2f640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f24640ae040 tx=0x7f246401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640ba020 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640b6420 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246c0cbd00 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640b0040 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246c0cc2c0 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.989+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246c0cc490 con 0x7f246c0d3940 2024-09-15T22:57:33.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.993+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24640bd020 con 0x7f246c0d3940 2024-09-15T22:57:33.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.993+0000 7f2461ffb640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 0x7f2450069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.993+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f246411fe20 con 0x7f246c0d3940 2024-09-15T22:57:33.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.993+0000 7f247122e640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 0x7f2450069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.993+0000 7f247122e640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 0x7f2450069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f246c15d430 tx=0x7f2468003a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:33.997+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24640c4030 con 0x7f246c0d3940 2024-09-15T22:57:34.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.221+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f246c0ce730 con 0x7f246c0d3940 2024-09-15T22:57:34.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2461ffb640 1 -- 172.21.15.28:0/3165114292 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) ==== 211+0+168 (secure 0 0 0) 0x7f2464016110 con 0x7f246c0d3940 2024-09-15T22:57:34.226 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:57:34.227 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:57:34.227 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow rwp" 2024-09-15T22:57:34.227 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:57:34.227 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-09-15T22:57:34.227 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 msgr2=0x7f2450069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 0x7f2450069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f246c15d430 tx=0x7f2468003a20 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 msgr2=0x7f246c15c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f24640ae040 tx=0x7f246401acd0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 shutdown_connections 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f246c0d3940 0x7f246c15c1b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f246c0b96d0 0x7f246c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f24500678c0 0x7f2450069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 --2- 172.21.15.28:0/3165114292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f246c0b67e0 0x7f246c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 >> 172.21.15.28:0/3165114292 conn(0x7f246c0d1330 msgr2=0x7f246c15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 shutdown_connections 2024-09-15T22:57:34.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.225+0000 7f2473492640 1 -- 172.21.15.28:0/3165114292 wait complete. 2024-09-15T22:57:34.246 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:57:34.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 Processor -- start 2024-09-15T22:57:34.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 -- start start 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f525c0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c0d2ba0 con 0x7f525c06d870 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c0d2e80 con 0x7f525c0b3610 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f52624ab640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0d3160 con 0x7f525c15e820 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f525c06d870 0x7f525c06dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38908/0 (socket says 172.21.15.28:38908) 2024-09-15T22:57:34.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525bfff640 1 -- 172.21.15.28:0/1165394552 learned_addr learned my addr 172.21.15.28:0/1165394552 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f525c0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254015771 0 0) 0x7f525c0d2ba0 con 0x7f525c06d870 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5244003530 con 0x7f525c06d870 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985767265 0 0) 0x7f5244003530 con 0x7f525c06d870 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 msgr2=0x7f525c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f525c0cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 >> v1:172.21.15.131:6789/0 conn(0x7f525c0b3610 legacy=0x7f525c0d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0d3440 con 0x7f525c06d870 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f524c001680 con 0x7f525c06d870 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 >> v1:172.21.15.28:6789/0 conn(0x7f525c06d870 legacy=0x7f525c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f52440039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f5244004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5244004d50 0x7f52440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0d3160 con 0x7f5244003f70 2024-09-15T22:57:34.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f524400bb40 con 0x7f5244004d50 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f524400bd40 con 0x7f525c15e820 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f5244004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525bfff640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f52440039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f5260a48640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5244004d50 0x7f52440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 -- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 msgr2=0x7f52440039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f52440039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 -- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5244004d50 msgr2=0x7f52440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:34.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5244004d50 0x7f52440051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525b7fe640 1 -- 172.21.15.28:0/1165394552 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5244003530 con 0x7f5244003f70 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.373+0000 7f525bfff640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c15e820 0x7f52440039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f5244004810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5250009ab0 tx=0x7f525001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae178de0609eac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52500b2070 con 0x7f5244003f70 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52500a5640 con 0x7f5244003f70 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f525affd640 1 -- 172.21.15.28:0/1165394552 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52500096b0 con 0x7f5244003f70 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- 172.21.15.28:0/1165394552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 msgr2=0x7f5244004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 --2- 172.21.15.28:0/1165394552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f5244004810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5250009ab0 tx=0x7f525001ca50 comp rx=0 tx=0).stop 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f5260a48640 1 -- 172.21.15.28:0/1165394552 reap_dead start 2024-09-15T22:57:34.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- 172.21.15.28:0/1165394552 shutdown_connections 2024-09-15T22:57:34.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- 172.21.15.28:0/1165394552 >> 172.21.15.28:0/1165394552 conn(0x7f525c0d4910 msgr2=0x7f525c0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:34.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- 172.21.15.28:0/1165394552 shutdown_connections 2024-09-15T22:57:34.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- 172.21.15.28:0/1165394552 wait complete. 2024-09-15T22:57:34.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 Processor -- start 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.377+0000 7f52624ab640 1 -- start start 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c152ed0 0x7f525c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f525c15a440 0x7f525c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0cf750 con 0x7f5244003f70 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0d4350 con 0x7f525c15a440 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0cf8d0 con 0x7f525c152ed0 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59162/0 (socket says 172.21.15.28:59162) 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 -- 172.21.15.28:0/1367169404 learned_addr learned my addr 172.21.15.28:0/1367169404 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c152ed0 0x7f525c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5260a48640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f525c15a440 0x7f525c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 -- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c152ed0 msgr2=0x7f525c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c152ed0 0x7f525c0cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 -- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f525c15a440 msgr2=0x7f525c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f525c15a440 0x7f525c15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 -- 172.21.15.28:0/1367169404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c153350 con 0x7f5244003f70 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525bfff640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d870 tx=0x7f524c00dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c019070 con 0x7f5244003f70 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c0074e0 con 0x7f5244003f70 2024-09-15T22:57:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c0cd010 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0049f0 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c0cd5d0 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0cfcc0 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f524c01c070 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 0x7f5248069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f524c0858e0 con 0x7f5244003f70 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 0x7f5248069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.381+0000 7f525b7fe640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 0x7f5248069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52500af000 tx=0x7f52500046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.385+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f524c055c40 con 0x7f5244003f70 2024-09-15T22:57:34.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f525c0b4b50 con 0x7f5244003f70 2024-09-15T22:57:34.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f5258ff9640 1 -- 172.21.15.28:0/1367169404 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+82 (secure 0 0 0) 0x7f524c059f40 con 0x7f5244003f70 2024-09-15T22:57:34.591 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 msgr2=0x7f5248069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 0x7f5248069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52500af000 tx=0x7f52500046d0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 msgr2=0x7f525c1616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d870 tx=0x7f524c00dd30 comp rx=0 tx=0).stop 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 shutdown_connections 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52480678c0 0x7f5248069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f525c15a440 0x7f525c15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f525c152ed0 0x7f525c0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 --2- 172.21.15.28:0/1367169404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5244003f70 0x7f525c1616c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:34.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 >> 172.21.15.28:0/1367169404 conn(0x7f525c0d4910 msgr2=0x7f525c0b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:34.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 shutdown_connections 2024-09-15T22:57:34.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34.589+0000 7f52624ab640 1 -- 172.21.15.28:0/1367169404 wait complete. 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:57:34.611 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:34.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:34.612 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:57:34.618 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:57:34.618 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:57:34.619 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:57:34.620 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:57:34.621 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:57:34.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:34.622 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:57:34.671 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:57:34.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:34.673 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:57:34.723 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:57:34.724 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:57:34.724 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:57:34.724 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:57:34.724 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:57:34.724 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:57:34.724 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:57:34.724 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:57:34.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:57:34.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:57:34.725 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:57:34.725 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:57:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:57:34.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:34.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:34.851 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:57:34.856 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:57:34.856 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:57:34.856 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:34.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:34.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:57:34.909 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:57:34.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:34.910 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:34.962 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:57:34.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:57:34.962 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:35.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:35.072 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:35.123 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:35.124 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:35.125 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:35.126 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:35.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:35.127 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:35.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:57:35.179 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:57:35.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:35.239 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:35.287 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:35.288 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:35.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:35.290 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:35.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:57:35.301+0000 7fa240021580 -1 init, newargv = 0x563de6cb2150 newargc=15 2024-09-15T22:57:35.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[38017]: starting ceph client 2024-09-15T22:57:35.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[38017]: starting fuse 2024-09-15T22:57:36.408 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:57:36.425 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:57:36.477 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:57:36.477 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:57:36.478 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:57:36.479 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:57:36.480 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:36.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.481 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:57:36.527 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:57:36.527 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:57:36.527 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:57:36.527 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:57:36.527 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:57:36.527 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:57:36.528 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:57:36.529 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:57:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.38017.asok 2024-09-15T22:57:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:57:36.667 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38017.asok 2024-09-15T22:57:36.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.668 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38017.asok status 2024-09-15T22:57:36.833 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "38017", 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:57:36.834 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5097, 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5097 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 3696148245 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:57:36.835 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 3696148245 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5097 192.168.0.1:0/3696148245", 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/3696148245", 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 17, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 34, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:57:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:57:36.837 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:36.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.849 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:57:36.849 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:36.855 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:57:36.855 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:36.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.856 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:36.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.910 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-09-15T22:57:36.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:36.968 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-09-15T22:57:37.025 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:37.025 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:37.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:37.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 Processor -- start 2024-09-15T22:57:37.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 -- start start 2024-09-15T22:57:37.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8328145970 0x7f83280b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83280b2300 0x7f83280cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83280d0960 con 0x7f83280d0190 2024-09-15T22:57:37.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f83280b2770 con 0x7f8328145970 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832ec54640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f83280d0f20 con 0x7f83280b2300 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8328145970 0x7f83280b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8328145970 0x7f83280b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59164/0 (socket says 172.21.15.28:59164) 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 -- 172.21.15.28:0/2508843154 learned_addr learned my addr 172.21.15.28:0/2508843154 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f8327fff640 1 --2- 172.21.15.28:0/2508843154 >> v2:172.21.15.131:3300/0 conn(0x7f83280b2300 0x7f83280cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 -- 172.21.15.28:0/2508843154 >> v2:172.21.15.131:3300/0 conn(0x7f83280b2300 msgr2=0x7f83280cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 --2- 172.21.15.28:0/2508843154 >> v2:172.21.15.131:3300/0 conn(0x7f83280b2300 0x7f83280cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 -- 172.21.15.28:0/2508843154 >> v1:172.21.15.131:6789/0 conn(0x7f83280d0190 legacy=0x7f8328072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.245+0000 7f832c9f0640 1 -- 172.21.15.28:0/2508843154 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83280d0c40 con 0x7f8328145970 2024-09-15T22:57:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832c9f0640 1 --2- 172.21.15.28:0/2508843154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8328145970 0x7f83280b1dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21bc248d0749a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f83277fe640 1 -- 172.21.15.28:0/2508843154 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180b2070 con 0x7f8328145970 2024-09-15T22:57:37.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f83277fe640 1 -- 172.21.15.28:0/2508843154 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83180a9070 con 0x7f8328145970 2024-09-15T22:57:37.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f83277fe640 1 -- 172.21.15.28:0/2508843154 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180ad880 con 0x7f8328145970 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 -- 172.21.15.28:0/2508843154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8328145970 msgr2=0x7f83280b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 --2- 172.21.15.28:0/2508843154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8328145970 0x7f83280b1dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831801c450 comp rx=0 tx=0).stop 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 -- 172.21.15.28:0/2508843154 shutdown_connections 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 --2- 172.21.15.28:0/2508843154 >> v2:172.21.15.131:3300/0 conn(0x7f83280b2300 0x7f83280cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 --2- 172.21.15.28:0/2508843154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8328145970 0x7f83280b1dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 -- 172.21.15.28:0/2508843154 >> 172.21.15.28:0/2508843154 conn(0x7f832806bcc0 msgr2=0x7f832806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 -- 172.21.15.28:0/2508843154 shutdown_connections 2024-09-15T22:57:37.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.249+0000 7f832ec54640 1 -- 172.21.15.28:0/2508843154 wait complete. 2024-09-15T22:57:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 Processor -- start 2024-09-15T22:57:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- start start 2024-09-15T22:57:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280b2300 0x7f832815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8328145970 0x7f83281f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8328168fe0 con 0x7f83280d0190 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8328168e60 con 0x7f83280b2300 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8328169160 con 0x7f8328145970 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59170/0 (socket says 172.21.15.28:59170) 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 -- 172.21.15.28:0/3013595633 learned_addr learned my addr 172.21.15.28:0/3013595633 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832c9f0640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280b2300 0x7f832815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 -- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8328145970 msgr2=0x7f83281f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832d1f1640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8328145970 0x7f83281f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8328145970 0x7f83281f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 -- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280b2300 msgr2=0x7f832815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280b2300 0x7f832815b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 -- 172.21.15.28:0/3013595633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832813c0c0 con 0x7f83280d0190 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f8327fff640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f831000d5f0 tx=0x7f831000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83100125f0 con 0x7f83280d0190 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8310019070 con 0x7f83280d0190 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832813af30 con 0x7f83280d0190 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83100129b0 con 0x7f83280d0190 2024-09-15T22:57:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8328140570 con 0x7f83280d0190 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83280cfc50 con 0x7f83280d0190 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8310012b50 con 0x7f83280d0190 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 0x7f8308069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f8310086190 con 0x7f83280d0190 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.253+0000 7f832c9f0640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 0x7f8308069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.257+0000 7f832c9f0640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 0x7f8308069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83180af000 tx=0x7f8318008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.261+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8310056bd0 con 0x7f83280d0190 2024-09-15T22:57:37.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8328050050 con 0x7f83280d0190 2024-09-15T22:57:37.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f83257fa640 1 -- 172.21.15.28:0/3013595633 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f83100564d0 con 0x7f83280d0190 2024-09-15T22:57:37.439 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:37.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 msgr2=0x7f8308069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 0x7f8308069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83180af000 tx=0x7f8318008040 comp rx=0 tx=0).stop 2024-09-15T22:57:37.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 msgr2=0x7f832813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f831000d5f0 tx=0x7f831000dab0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 shutdown_connections 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8328145970 0x7f83281f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83280d0190 0x7f832813bb80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f83080678f0 0x7f8308069db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 --2- 172.21.15.28:0/3013595633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280b2300 0x7f832815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 >> 172.21.15.28:0/3013595633 conn(0x7f832806bcc0 msgr2=0x7f832806c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 shutdown_connections 2024-09-15T22:57:37.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.437+0000 7f832ec54640 1 -- 172.21.15.28:0/3013595633 wait complete. 2024-09-15T22:57:37.458 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:37.458 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:37.464 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:57:37.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 Processor -- start 2024-09-15T22:57:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 -- start start 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd2c0b24d0 0x7efd2c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd2c0d0190 0x7efd2c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2c0d0960 con 0x7efd2c145970 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c0d0f20 con 0x7efd2c0d0190 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd31a2a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c0cd620 con 0x7efd2c0b24d0 2024-09-15T22:57:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd2c0d0190 0x7efd2c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd2c0d0190 0x7efd2c0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59182/0 (socket says 172.21.15.28:59182) 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 -- 172.21.15.28:0/1321056469 learned_addr learned my addr 172.21.15.28:0/1321056469 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2a7fc640 1 --2- 172.21.15.28:0/1321056469 >> v2:172.21.15.131:3300/0 conn(0x7efd2c0b24d0 0x7efd2c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 -- 172.21.15.28:0/1321056469 >> v2:172.21.15.131:3300/0 conn(0x7efd2c0b24d0 msgr2=0x7efd2c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 --2- 172.21.15.28:0/1321056469 >> v2:172.21.15.131:3300/0 conn(0x7efd2c0b24d0 0x7efd2c0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 -- 172.21.15.28:0/1321056469 >> v1:172.21.15.131:6789/0 conn(0x7efd2c145970 legacy=0x7efd2c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.633+0000 7efd2b7fe640 1 -- 172.21.15.28:0/1321056469 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0d0c40 con 0x7efd2c0d0190 2024-09-15T22:57:37.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd2b7fe640 1 --2- 172.21.15.28:0/1321056469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c0cdab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0afd50 tx=0x7efd2401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e299fe744dbca41a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd29ffb640 1 -- 172.21.15.28:0/1321056469 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd240a5780 con 0x7efd2c0d0190 2024-09-15T22:57:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd29ffb640 1 -- 172.21.15.28:0/1321056469 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd240a5920 con 0x7efd2c0d0190 2024-09-15T22:57:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd29ffb640 1 -- 172.21.15.28:0/1321056469 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd240a5cf0 con 0x7efd2c0d0190 2024-09-15T22:57:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- 172.21.15.28:0/1321056469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 msgr2=0x7efd2c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 --2- 172.21.15.28:0/1321056469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c0cdab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0afd50 tx=0x7efd2401c930 comp rx=0 tx=0).stop 2024-09-15T22:57:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- 172.21.15.28:0/1321056469 shutdown_connections 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 --2- 172.21.15.28:0/1321056469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c0cdab0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 --2- 172.21.15.28:0/1321056469 >> v2:172.21.15.131:3300/0 conn(0x7efd2c0b24d0 0x7efd2c0cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- 172.21.15.28:0/1321056469 >> 172.21.15.28:0/1321056469 conn(0x7efd2c06bcc0 msgr2=0x7efd2c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- 172.21.15.28:0/1321056469 shutdown_connections 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- 172.21.15.28:0/1321056469 wait complete. 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 Processor -- start 2024-09-15T22:57:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.637+0000 7efd31a2a640 1 -- start start 2024-09-15T22:57:37.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd2c0b24d0 0x7efd2c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd2c145970 0x7efd2c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0ce980 con 0x7efd2c0d0190 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0ce800 con 0x7efd2c145970 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0ceb00 con 0x7efd2c0b24d0 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59192/0 (socket says 172.21.15.28:59192) 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 -- 172.21.15.28:0/835522523 learned_addr learned my addr 172.21.15.28:0/835522523 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2affd640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd2c0b24d0 0x7efd2c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2b7fe640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd2c145970 0x7efd2c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 -- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd2c0b24d0 msgr2=0x7efd2c15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd2c0b24d0 0x7efd2c15b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 -- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd2c145970 msgr2=0x7efd2c143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd2c145970 0x7efd2c143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 -- 172.21.15.28:0/835522523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c13be80 con 0x7efd2c0d0190 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2a7fc640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d800 tx=0x7efd2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000b6c0 con 0x7efd2c0d0190 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd20019070 con 0x7efd2c0d0190 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c13c160 con 0x7efd2c0d0190 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000ba60 con 0x7efd2c0d0190 2024-09-15T22:57:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c136050 con 0x7efd2c0d0190 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c0cfc50 con 0x7efd2c0d0190 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd2000bc00 con 0x7efd2c0d0190 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 0x7efd18069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7efd20086220 con 0x7efd2c0d0190 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.641+0000 7efd2affd640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 0x7efd18069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.645+0000 7efd2affd640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 0x7efd18069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000f70 tx=0x7efd1c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.645+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd20056c60 con 0x7efd2c0d0190 2024-09-15T22:57:37.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.821+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd2c072e30 con 0x7efd2c0d0190 2024-09-15T22:57:37.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.821+0000 7efd13fff640 1 -- 172.21.15.28:0/835522523 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7efd20056560 con 0x7efd2c0d0190 2024-09-15T22:57:37.825 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 msgr2=0x7efd18069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 0x7efd18069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000f70 tx=0x7efd1c009040 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 msgr2=0x7efd2c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d800 tx=0x7efd2000dcc0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 shutdown_connections 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd180678f0 0x7efd18069db0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd2c145970 0x7efd2c143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd2c0d0190 0x7efd2c1430d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 --2- 172.21.15.28:0/835522523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd2c0b24d0 0x7efd2c15b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 >> 172.21.15.28:0/835522523 conn(0x7efd2c06bcc0 msgr2=0x7efd2c13f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 shutdown_connections 2024-09-15T22:57:37.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:37.825+0000 7efd31a2a640 1 -- 172.21.15.28:0/835522523 wait complete. 2024-09-15T22:57:37.844 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:57:37.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:37.844 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:57:37.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[38017]: fuse finished with error 0 and tester_r 0 2024-09-15T22:57:37.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:37.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:57:37.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:37.891 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:57:37.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-09-15T22:57:38.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.117+0000 7fbd6a292640 1 Processor -- start 2024-09-15T22:57:38.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.117+0000 7fbd6a292640 1 -- start start 2024-09-15T22:57:38.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6a292640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 0x7fbd6406f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6a292640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbd6406f8c0 0x7fbd640b7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6a292640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6415c8c0 con 0x7fbd640b5410 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6a292640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6415cba0 con 0x7fbd6406f8c0 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6a292640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6415ce80 con 0x7fbd6415c310 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbd6406f8c0 0x7fbd640b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd637fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbd640b5410 0x7fbd640b6d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38910/0 (socket says 172.21.15.28:38910) 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd637fe640 1 -- 172.21.15.28:0/3168703499 learned_addr learned my addr 172.21.15.28:0/3168703499 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd62ffd640 1 -- 172.21.15.28:0/3168703499 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714336382 0 0) 0x7fbd6415c8c0 con 0x7fbd640b5410 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd62ffd640 1 -- 172.21.15.28:0/3168703499 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd4c003530 con 0x7fbd640b5410 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd63fff640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 0x7fbd6406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 -- 172.21.15.28:0/3168703499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 msgr2=0x7fbd6406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 0x7fbd6406f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 -- 172.21.15.28:0/3168703499 >> v1:172.21.15.28:6789/0 conn(0x7fbd640b5410 legacy=0x7fbd640b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 -- 172.21.15.28:0/3168703499 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6415d160 con 0x7fbd6406f8c0 2024-09-15T22:57:38.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd63fff640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 0x7fbd6406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd6882f640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd6406f8c0 0x7fbd640b7430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009d90 tx=0x7fbd5c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865281130be85dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd62ffd640 1 -- 172.21.15.28:0/3168703499 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0b2070 con 0x7fbd6406f8c0 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd62ffd640 1 -- 172.21.15.28:0/3168703499 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0a5830 con 0x7fbd6406f8c0 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.121+0000 7fbd62ffd640 1 -- 172.21.15.28:0/3168703499 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0a5c00 con 0x7fbd6406f8c0 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/3168703499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd6406f8c0 msgr2=0x7fbd640b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd6406f8c0 0x7fbd640b7430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009d90 tx=0x7fbd5c01c970 comp rx=0 tx=0).stop 2024-09-15T22:57:38.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/3168703499 shutdown_connections 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd6406f8c0 0x7fbd640b7430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- 172.21.15.28:0/3168703499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6415c310 0x7fbd6406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/3168703499 >> 172.21.15.28:0/3168703499 conn(0x7fbd640b4110 msgr2=0x7fbd640b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/3168703499 shutdown_connections 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/3168703499 wait complete. 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 Processor -- start 2024-09-15T22:57:38.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- start start 2024-09-15T22:57:38.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 0x7fbd6414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd6415c310 0x7fbd641652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64160a40 con 0x7fbd640b5410 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbd641608c0 con 0x7fbd6415c310 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fbd64160bc0 con 0x7fbd6406f8c0 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59206/0 (socket says 172.21.15.28:59206) 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 -- 172.21.15.28:0/2079503583 learned_addr learned my addr 172.21.15.28:0/2079503583 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 -- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 msgr2=0x7fbd6414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd63fff640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 0x7fbd6414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6882f640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd6415c310 0x7fbd641652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 0x7fbd6414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 -- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd6415c310 msgr2=0x7fbd641652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd6415c310 0x7fbd641652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 -- 172.21.15.28:0/2079503583 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd64157db0 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd63fff640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 0x7fbd6414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd637fe640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c450 tx=0x7fbd5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58017070 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58005cf0 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd64158090 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58007290 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.125+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd640b3dd0 con 0x7fbd640b5410 2024-09-15T22:57:38.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6406f380 con 0x7fbd640b5410 2024-09-15T22:57:38.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd5801a070 con 0x7fbd640b5410 2024-09-15T22:57:38.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd60ff9640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 0x7fbd50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:38.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7fbd58085210 con 0x7fbd640b5410 2024-09-15T22:57:38.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd63fff640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 0x7fbd50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:38.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.129+0000 7fbd63fff640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 0x7fbd50069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd54008890 tx=0x7fbd54008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:38.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.133+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd58055bc0 con 0x7fbd640b5410 2024-09-15T22:57:38.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.349+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7fbd64158260 con 0x7fbd640b5410 2024-09-15T22:57:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd60ff9640 1 -- 172.21.15.28:0/2079503583 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) ==== 184+0+141 (secure 0 0 0) 0x7fbd580554c0 con 0x7fbd640b5410 2024-09-15T22:57:38.355 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:57:38.355 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:57:38.355 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:57:38.356 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:57:38.356 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs_data" 2024-09-15T22:57:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 msgr2=0x7fbd50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 0x7fbd50069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd54008890 tx=0x7fbd54008040 comp rx=0 tx=0).stop 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 msgr2=0x7fbd6414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c450 tx=0x7fbd5800c910 comp rx=0 tx=0).stop 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 shutdown_connections 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fbd500678c0 0x7fbd50069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd6415c310 0x7fbd641652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd640b5410 0x7fbd6414e150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 --2- 172.21.15.28:0/2079503583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbd6406f8c0 0x7fbd6414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 >> 172.21.15.28:0/2079503583 conn(0x7fbd640b4110 msgr2=0x7fbd6415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 shutdown_connections 2024-09-15T22:57:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.353+0000 7fbd6a292640 1 -- 172.21.15.28:0/2079503583 wait complete. 2024-09-15T22:57:38.374 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:57:38.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:57:38.447 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:57:38.531 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:57:38.531 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:57:38.531 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:38.531 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:38.537 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:57:38.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:57:38.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:38.538 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:57:38.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:38.587 INFO:teuthology.orchestra.run.smithi028.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-15T22:57:38.587 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:57:38.587 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:57:38.587 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:38.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:57:38.594 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:57:38.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:38.594 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:57:38.641 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T22:57:38.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:38.642 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:57:38.643 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:38.643 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:38.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:57:38.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:57:38.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:38.649 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T22:57:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T22:57:38.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:38.696 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:57:38.696 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:57:38.696 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:38.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:57:38.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:57:38.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:57:38.702 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T22:57:38.749 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T22:57:38.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:57:38.750 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:38.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 Processor -- start 2024-09-15T22:57:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 -- start start 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f503c0cca90 0x7f503c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f503c0b55e0 con 0x7f503c0b5200 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f503c0cd020 con 0x7f503c0b1dc0 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f50442ae640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f503c0ce3b0 con 0x7f503c0cca90 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f503c0b5200 0x7f503c0b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38914/0 (socket says 172.21.15.28:38914) 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 -- 172.21.15.28:0/114753909 learned_addr learned my addr 172.21.15.28:0/114753909 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041849640 1 --2- 172.21.15.28:0/114753909 >> v2:172.21.15.131:3300/0 conn(0x7f503c0cca90 0x7f503c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398864010 0 0) 0x7f503c0b55e0 con 0x7f503c0b5200 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5028003530 con 0x7f503c0b5200 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3262312511 0 0) 0x7f5028003530 con 0x7f503c0b5200 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 >> v2:172.21.15.131:3300/0 conn(0x7f503c0cca90 msgr2=0x7f503c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 --2- 172.21.15.28:0/114753909 >> v2:172.21.15.131:3300/0 conn(0x7f503c0cca90 0x7f503c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 >> v1:172.21.15.131:6789/0 conn(0x7f503c0b1dc0 legacy=0x7f503c0b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503c0cd300 con 0x7f503c0b5200 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f5038001680 con 0x7f503c0b5200 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 >> v1:172.21.15.28:6789/0 conn(0x7f503c0b5200 legacy=0x7f503c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 0x7f5028003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5028004810 0x7f5028004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280051d0 0x7f502800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f502800c140 con 0x7f50280039c0 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f502800c2f0 con 0x7f5028004810 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f502800c4f0 con 0x7f50280051d0 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 0x7f5028003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041849640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5028004810 0x7f5028004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504284b640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280051d0 0x7f502800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 -- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280051d0 msgr2=0x7f502800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280051d0 0x7f502800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 -- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5028004810 msgr2=0x7f5028004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5028004810 0x7f5028004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504204a640 1 -- 172.21.15.28:0/114753909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5028003530 con 0x7f50280039c0 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f504284b640 1 -- 172.21.15.28:0/114753909 reap_dead start 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.881+0000 7f5041849640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5028004810 0x7f5028004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f504204a640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 0x7f5028003de0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f503800c1c0 tx=0x7f503801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcdbc34b8ca5841 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038007d00 con 0x7f50280039c0 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50380a9020 con 0x7f50280039c0 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f5041048640 1 -- 172.21.15.28:0/114753909 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038005ae0 con 0x7f50280039c0 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 -- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 msgr2=0x7f5028003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 0x7f5028003de0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f503800c1c0 tx=0x7f503801cc60 comp rx=0 tx=0).stop 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 -- 172.21.15.28:0/114753909 shutdown_connections 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 --2- 172.21.15.28:0/114753909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50280039c0 0x7f5028003de0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 -- 172.21.15.28:0/114753909 >> 172.21.15.28:0/114753909 conn(0x7f503c06bcc0 msgr2=0x7f503c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 -- 172.21.15.28:0/114753909 shutdown_connections 2024-09-15T22:57:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.885+0000 7f50442ae640 1 -- 172.21.15.28:0/114753909 wait complete. 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 Processor -- start 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- start start 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280039c0 0x7f503c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f503c1f8e70 0x7f503c1f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f503c0b4960 con 0x7f503c151930 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f503c0b47e0 con 0x7f503c1f8e70 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f503c0b3d40 con 0x7f50280039c0 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59220/0 (socket says 172.21.15.28:59220) 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 -- 172.21.15.28:0/249684825 learned_addr learned my addr 172.21.15.28:0/249684825 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f504204a640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280039c0 0x7f503c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f504284b640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f503c1f8e70 0x7f503c1f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 -- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280039c0 msgr2=0x7f503c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280039c0 0x7f503c15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 -- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f503c1f8e70 msgr2=0x7f503c1f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f503c1f8e70 0x7f503c1f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 -- 172.21.15.28:0/249684825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503c1eb140 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5041849640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f502c0107f0 tx=0x7f502c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00f040 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c004220 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503c1eb420 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00e960 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503c1ea360 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f503c0b40d0 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f502c00eb00 con 0x7f503c151930 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f502c085ff0 con 0x7f503c151930 2024-09-15T22:57:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.889+0000 7f504204a640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.893+0000 7f504204a640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 0x7f5020069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50380aa000 tx=0x7f503c0cd1f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:38.897+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f502c018030 con 0x7f503c151930 2024-09-15T22:57:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f503c15b360 con 0x7f503c151930 2024-09-15T22:57:39.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f5032ffd640 1 -- 172.21.15.28:0/249684825 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5231 (secure 0 0 0) 0x7f502c0569b0 con 0x7f503c151930 2024-09-15T22:57:39.092 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:39.092 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"btime":"2024-09-15T22:57:21:976822+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:21.329043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:39.092 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 17 2024-09-15T22:57:39.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 msgr2=0x7f5020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 0x7f5020069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50380aa000 tx=0x7f503c0cd1f0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 msgr2=0x7f503c155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f502c0107f0 tx=0x7f502c010cb0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 shutdown_connections 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f50200678c0 0x7f5020069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f503c1f8e70 0x7f503c1f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f503c151930 0x7f503c155ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 --2- 172.21.15.28:0/249684825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50280039c0 0x7f503c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.089+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 >> 172.21.15.28:0/249684825 conn(0x7f503c06bcc0 msgr2=0x7f503c15ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.093+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 shutdown_connections 2024-09-15T22:57:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.093+0000 7f50442ae640 1 -- 172.21.15.28:0/249684825 wait complete. 2024-09-15T22:57:39.109 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:39.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 Processor -- start 2024-09-15T22:57:39.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 -- start start 2024-09-15T22:57:39.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff6300cde30 0x7ff6300b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6300b4bd0 con 0x7ff6300b4710 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6300b4eb0 con 0x7ff6300ce210 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff635c5a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff63015f260 con 0x7ff6300cde30 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff6300cde30 0x7ff6300b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff6300b4710 0x7ff6300ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38918/0 (socket says 172.21.15.28:38918) 2024-09-15T22:57:39.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62effd640 1 -- 172.21.15.28:0/201377950 learned_addr learned my addr 172.21.15.28:0/201377950 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:39.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62f7fe640 1 -- 172.21.15.28:0/201377950 >> v1:172.21.15.131:6789/0 conn(0x7ff6300ce210 legacy=0x7ff63015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62f7fe640 1 -- 172.21.15.28:0/201377950 >> v1:172.21.15.28:6789/0 conn(0x7ff6300b4710 legacy=0x7ff6300ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.225+0000 7ff62f7fe640 1 -- 172.21.15.28:0/201377950 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6300b5190 con 0x7ff6300cde30 2024-09-15T22:57:39.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62f7fe640 1 --2- 172.21.15.28:0/201377950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff6300b3b40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff62800aea0 tx=0x7ff62801d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a03ecdbe75fcdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62e7fc640 1 -- 172.21.15.28:0/201377950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280a6710 con 0x7ff6300cde30 2024-09-15T22:57:39.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62e7fc640 1 -- 172.21.15.28:0/201377950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6280a68b0 con 0x7ff6300cde30 2024-09-15T22:57:39.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62e7fc640 1 -- 172.21.15.28:0/201377950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280a6c80 con 0x7ff6300cde30 2024-09-15T22:57:39.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- 172.21.15.28:0/201377950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 msgr2=0x7ff6300b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 --2- 172.21.15.28:0/201377950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff6300b3b40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff62800aea0 tx=0x7ff62801d9a0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- 172.21.15.28:0/201377950 shutdown_connections 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 --2- 172.21.15.28:0/201377950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff6300b3b40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- 172.21.15.28:0/201377950 >> 172.21.15.28:0/201377950 conn(0x7ff63006bcc0 msgr2=0x7ff63006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- 172.21.15.28:0/201377950 shutdown_connections 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- 172.21.15.28:0/201377950 wait complete. 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 Processor -- start 2024-09-15T22:57:39.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- start start 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6300b4710 0x7ff630157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6300ce210 0x7ff630155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6300cfed0 con 0x7ff6300cde30 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff63015ed00 con 0x7ff6300ce210 2024-09-15T22:57:39.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff635c5a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff6300d0050 con 0x7ff6300b4710 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59252/0 (socket says 172.21.15.28:59252) 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 -- 172.21.15.28:0/31565185 learned_addr learned my addr 172.21.15.28:0/31565185 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62f7fe640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6300b4710 0x7ff630157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 -- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6300b4710 msgr2=0x7ff630157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62ffff640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6300ce210 0x7ff630155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6300b4710 0x7ff630157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 -- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6300ce210 msgr2=0x7ff630155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6300ce210 0x7ff630155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.229+0000 7ff62effd640 1 -- 172.21.15.28:0/31565185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63015d3d0 con 0x7ff6300cde30 2024-09-15T22:57:39.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff62effd640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c420 tx=0x7ff62400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624017070 con 0x7ff6300cde30 2024-09-15T22:57:39.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff624005cf0 con 0x7ff6300cde30 2024-09-15T22:57:39.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6240072f0 con 0x7ff6300cde30 2024-09-15T22:57:39.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6300d0a60 con 0x7ff6300cde30 2024-09-15T22:57:39.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6300cc2e0 con 0x7ff6300cde30 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6301576f0 con 0x7ff6300cde30 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff62401a070 con 0x7ff6300cde30 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 0x7ff61c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7ff624085250 con 0x7ff6300cde30 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff62f7fe640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 0x7ff61c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.233+0000 7ff62f7fe640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 0x7ff61c069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6280af000 tx=0x7ff6280a8070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.237+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff624055b80 con 0x7ff6300cde30 2024-09-15T22:57:39.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.441+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6300b3b40 con 0x7ff6300cde30 2024-09-15T22:57:39.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.441+0000 7ff617fff640 1 -- 172.21.15.28:0/31565185 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5231 (secure 0 0 0) 0x7ff624055480 con 0x7ff6300cde30 2024-09-15T22:57:39.445 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:39.445 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"btime":"2024-09-15T22:57:21:976822+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:21.329043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:39.445 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 17 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 msgr2=0x7ff61c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 0x7ff61c069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6280af000 tx=0x7ff6280a8070 comp rx=0 tx=0).stop 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 msgr2=0x7ff630158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff62400c420 tx=0x7ff62400c8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 shutdown_connections 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff61c0678c0 0x7ff61c069d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6300ce210 0x7ff630155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6300cde30 0x7ff630158940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 --2- 172.21.15.28:0/31565185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6300b4710 0x7ff630157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 >> 172.21.15.28:0/31565185 conn(0x7ff63006bcc0 msgr2=0x7ff63015db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 shutdown_connections 2024-09-15T22:57:39.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.445+0000 7ff635c5a640 1 -- 172.21.15.28:0/31565185 wait complete. 2024-09-15T22:57:39.464 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:39.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 Processor -- start 2024-09-15T22:57:39.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 -- start start 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12d406d870 0x7f12d406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f12d415e820 0x7f12d40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d406e190 con 0x7f12d40b3610 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f12d40d2ba0 con 0x7f12d406d870 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d90d2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f12d40d2e80 con 0x7f12d415e820 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d2d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12d406d870 0x7f12d406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d359e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f12d40b3610 0x7f12d40d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38920/0 (socket says 172.21.15.28:38920) 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d359e640 1 -- 172.21.15.28:0/4261384796 learned_addr learned my addr 172.21.15.28:0/4261384796 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d259c640 1 --2- 172.21.15.28:0/4261384796 >> v2:172.21.15.131:3300/0 conn(0x7f12d415e820 0x7f12d40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d2d9d640 1 -- 172.21.15.28:0/4261384796 >> v2:172.21.15.131:3300/0 conn(0x7f12d415e820 msgr2=0x7f12d40cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d2d9d640 1 --2- 172.21.15.28:0/4261384796 >> v2:172.21.15.131:3300/0 conn(0x7f12d415e820 0x7f12d40cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d2d9d640 1 -- 172.21.15.28:0/4261384796 >> v1:172.21.15.28:6789/0 conn(0x7f12d40b3610 legacy=0x7f12d40d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.581+0000 7f12d2d9d640 1 -- 172.21.15.28:0/4261384796 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d40d3160 con 0x7f12d406d870 2024-09-15T22:57:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d2d9d640 1 --2- 172.21.15.28:0/4261384796 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d406d870 0x7f12d406dc50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12d408d8d0 tx=0x7f12c401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dbf0aa49be3a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d1d9b640 1 -- 172.21.15.28:0/4261384796 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c40ab680 con 0x7f12d406d870 2024-09-15T22:57:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d1d9b640 1 -- 172.21.15.28:0/4261384796 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c40b0070 con 0x7f12d406d870 2024-09-15T22:57:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d1d9b640 1 -- 172.21.15.28:0/4261384796 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c40aba40 con 0x7f12d406d870 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- 172.21.15.28:0/4261384796 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d406d870 msgr2=0x7f12d406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- 172.21.15.28:0/4261384796 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d406d870 0x7f12d406dc50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12d408d8d0 tx=0x7f12c401c480 comp rx=0 tx=0).stop 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- 172.21.15.28:0/4261384796 shutdown_connections 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- 172.21.15.28:0/4261384796 >> v2:172.21.15.131:3300/0 conn(0x7f12d415e820 0x7f12d40cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- 172.21.15.28:0/4261384796 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d406d870 0x7f12d406dc50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- 172.21.15.28:0/4261384796 >> 172.21.15.28:0/4261384796 conn(0x7f12d40d4910 msgr2=0x7f12d40d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- 172.21.15.28:0/4261384796 shutdown_connections 2024-09-15T22:57:39.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- 172.21.15.28:0/4261384796 wait complete. 2024-09-15T22:57:39.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 Processor -- start 2024-09-15T22:57:39.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- start start 2024-09-15T22:57:39.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12d406d870 0x7f12d4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 0x7f12d41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12d416b1a0 con 0x7f12d415e820 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f12d40d4350 con 0x7f12d40b3610 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.585+0000 7f12d90d2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f12d416b320 con 0x7f12d406d870 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59264/0 (socket says 172.21.15.28:59264) 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 -- 172.21.15.28:0/1527574012 learned_addr learned my addr 172.21.15.28:0/1527574012 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d259c640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 0x7f12d41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d2d9d640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12d406d870 0x7f12d4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 -- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12d406d870 msgr2=0x7f12d4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12d406d870 0x7f12d4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 -- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 msgr2=0x7f12d41584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 0x7f12d41584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 -- 172.21.15.28:0/1527574012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d40cb810 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d259c640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 0x7f12d41584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d359e640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00cbc0 tx=0x7f12cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc017070 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc00ad40 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d40cbaf0 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc012600 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d4152170 con 0x7f12d415e820 2024-09-15T22:57:39.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d406dc50 con 0x7f12d415e820 2024-09-15T22:57:39.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12cc01a070 con 0x7f12d415e820 2024-09-15T22:57:39.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f12cc085fd0 con 0x7f12d415e820 2024-09-15T22:57:39.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d2d9d640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.589+0000 7f12d2d9d640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 0x7f12c0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12c40af000 tx=0x7f12c40a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.593+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12cc0563a0 con 0x7f12d415e820 2024-09-15T22:57:39.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.757+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12d40d4f00 con 0x7f12d415e820 2024-09-15T22:57:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.757+0000 7f12bb7fe640 1 -- 172.21.15.28:0/1527574012 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+18577 (secure 0 0 0) 0x7f12cc05a6a0 con 0x7f12d415e820 2024-09-15T22:57:39.760 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:39.760 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":34,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:22.978741+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-15T22:57:20.775343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 msgr2=0x7f12c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 0x7f12c0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12c40af000 tx=0x7f12c40a7000 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 msgr2=0x7f12d4150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00cbc0 tx=0x7f12cc00a430 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 shutdown_connections 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12d415e820 0x7f12d4150c90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12d40b3610 0x7f12d41584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 --2- 172.21.15.28:0/1527574012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12d406d870 0x7f12d4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 >> 172.21.15.28:0/1527574012 conn(0x7f12d40d4910 msgr2=0x7f12d40b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 shutdown_connections 2024-09-15T22:57:39.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.761+0000 7f12d90d2640 1 -- 172.21.15.28:0/1527574012 wait complete. 2024-09-15T22:57:39.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:57:39.780 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:39.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 Processor -- start 2024-09-15T22:57:39.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 -- start start 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8aa00cca90 0x7f8aa015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa00b55e0 con 0x7f8aa00b5200 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa00cd020 con 0x7f8aa00b1dc0 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa7258640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa00ce3b0 con 0x7f8aa00cca90 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa4ff4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8aa00b5200 0x7f8aa00b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38934/0 (socket says 172.21.15.28:38934) 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa4ff4640 1 -- 172.21.15.28:0/2316881185 learned_addr learned my addr 172.21.15.28:0/2316881185 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705716212 0 0) 0x7f8aa00b55e0 con 0x7f8aa00b5200 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a90003530 con 0x7f8aa00b5200 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9ffff640 1 --2- 172.21.15.28:0/2316881185 >> v2:172.21.15.131:3300/0 conn(0x7f8aa00cca90 0x7f8aa015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 105606160 0 0) 0x7f8a90003530 con 0x7f8aa00b5200 2024-09-15T22:57:39.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 >> v2:172.21.15.131:3300/0 conn(0x7f8aa00cca90 msgr2=0x7f8aa015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 --2- 172.21.15.28:0/2316881185 >> v2:172.21.15.131:3300/0 conn(0x7f8aa00cca90 0x7f8aa015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 >> v1:172.21.15.131:6789/0 conn(0x7f8aa00b1dc0 legacy=0x7f8aa00b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa00cd300 con 0x7f8aa00b5200 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f8a94001680 con 0x7f8aa00b5200 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 >> v1:172.21.15.28:6789/0 conn(0x7f8aa00b5200 legacy=0x7f8aa00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900039c0 0x7f8a90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a90004810 0x7f8a90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 0x7f8a9000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9000e3a0 con 0x7f8a900052f0 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9000e550 con 0x7f8a90004810 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9000e750 con 0x7f8a900039c0 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 0x7f8a9000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8a9ffff640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a90004810 0x7f8a90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa4ff4640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900039c0 0x7f8a90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 -- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900039c0 msgr2=0x7f8a90003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900039c0 0x7f8a90003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 -- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a90004810 msgr2=0x7f8a90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a90004810 0x7f8a90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.897+0000 7f8aa57f5640 1 -- 172.21.15.28:0/2316881185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a90003530 con 0x7f8a900052f0 2024-09-15T22:57:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 -- 172.21.15.28:0/2316881185 reap_dead start 2024-09-15T22:57:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 0x7f8a9000dbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001e40 tx=0x7f8a9801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761387ee2035d628 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98001a90 con 0x7f8a900052f0 2024-09-15T22:57:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a98003b80 con 0x7f8a900052f0 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8a9f7fe640 1 -- 172.21.15.28:0/2316881185 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a980050d0 con 0x7f8a900052f0 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 msgr2=0x7f8a9000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 0x7f8a9000dbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8a98001e40 tx=0x7f8a9801c760 comp rx=0 tx=0).stop 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- 172.21.15.28:0/2316881185 shutdown_connections 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 --2- 172.21.15.28:0/2316881185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a900052f0 0x7f8a9000dbe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- 172.21.15.28:0/2316881185 >> 172.21.15.28:0/2316881185 conn(0x7f8aa006bcc0 msgr2=0x7f8aa006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- 172.21.15.28:0/2316881185 shutdown_connections 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- 172.21.15.28:0/2316881185 wait complete. 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 Processor -- start 2024-09-15T22:57:39.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- start start 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 0x7f8aa01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 0x7f8aa0155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa015c0b0 con 0x7f8aa0153610 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa00cd8c0 con 0x7f8aa0153190 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa7258640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa015c230 con 0x7f8a900052f0 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59282/0 (socket says 172.21.15.28:59282) 2024-09-15T22:57:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 -- 172.21.15.28:0/1505516775 learned_addr learned my addr 172.21.15.28:0/1505516775 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8a9ffff640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 0x7f8aa0155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa4ff4640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 0x7f8aa01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 -- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 msgr2=0x7f8aa01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 0x7f8aa01564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 -- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 msgr2=0x7f8aa0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.901+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 0x7f8aa0155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa57f5640 1 -- 172.21.15.28:0/1505516775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa01569f0 con 0x7f8aa0153610 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa4ff4640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 0x7f8aa01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9ffff640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 0x7f8aa0155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa57f5640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a9801c590 tx=0x7f8a90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98001a90 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a980012e0 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa0156c90 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a980a9860 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa0157250 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa00b43d0 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a980bd3f0 con 0x7f8aa0153610 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 0x7f8a84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa4ff4640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 0x7f8a84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:39.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f8a9811f9e0 con 0x7f8aa0153610 2024-09-15T22:57:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.905+0000 7f8aa4ff4640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 0x7f8a84069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a94000c10 tx=0x7f8a940014d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:39.909+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a98016470 con 0x7f8aa0153610 2024-09-15T22:57:40.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aa015efc0 con 0x7f8aa0153610 2024-09-15T22:57:40.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8a9d7fa640 1 -- 172.21.15.28:0/1505516775 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5231 (secure 0 0 0) 0x7f8a980f0420 con 0x7f8aa0153610 2024-09-15T22:57:40.103 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:40.104 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"btime":"2024-09-15T22:57:21:976822+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:21.329043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:40.104 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 17 2024-09-15T22:57:40.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 msgr2=0x7f8a84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 0x7f8a84069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a94000c10 tx=0x7f8a940014d0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 msgr2=0x7f8aa01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a9801c590 tx=0x7f8a90005840 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 shutdown_connections 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8aa0153610 0x7f8aa01557b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8a840678c0 0x7f8a84069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8aa0153190 0x7f8aa0155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 --2- 172.21.15.28:0/1505516775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a900052f0 0x7f8aa01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 >> 172.21.15.28:0/1505516775 conn(0x7f8aa006bcc0 msgr2=0x7f8aa015f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 shutdown_connections 2024-09-15T22:57:40.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.101+0000 7f8aa7258640 1 -- 172.21.15.28:0/1505516775 wait complete. 2024-09-15T22:57:40.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:40.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 Processor -- start 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 -- start start 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14fc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14fc0b1dc0 0x7f14fc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc0b55e0 con 0x7f14fc0b5200 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f14fc0ce3b0 con 0x7f14fc0b1dc0 2024-09-15T22:57:40.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f1504343640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f14fc0b2750 con 0x7f14fc0cca90 2024-09-15T22:57:40.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f15020df640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f14fc0b5200 0x7f14fc0b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38942/0 (socket says 172.21.15.28:38942) 2024-09-15T22:57:40.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f15020df640 1 -- 172.21.15.28:0/2751230156 learned_addr learned my addr 172.21.15.28:0/2751230156 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:40.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.241+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875582286 0 0) 0x7f14fc0b55e0 con 0x7f14fc0b5200 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e8003530 con 0x7f14fc0b5200 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 --2- 172.21.15.28:0/2751230156 >> v2:172.21.15.131:3300/0 conn(0x7f14fc0b1dc0 0x7f14fc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15018de640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14fc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 955379159 0 0) 0x7f14e8003530 con 0x7f14fc0b5200 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 msgr2=0x7f14fc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14fc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 >> v2:172.21.15.131:3300/0 conn(0x7f14fc0b1dc0 msgr2=0x7f14fc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 --2- 172.21.15.28:0/2751230156 >> v2:172.21.15.131:3300/0 conn(0x7f14fc0b1dc0 0x7f14fc0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc0cd020 con 0x7f14fc0b5200 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f14ec001680 con 0x7f14fc0b5200 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 >> v1:172.21.15.28:6789/0 conn(0x7f14fc0b5200 legacy=0x7f14fc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14e80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8003f90 0x7f14e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14e8004d50 0x7f14e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc0b2750 con 0x7f14e8004d50 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f14e800bab0 con 0x7f14e8003f90 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f14e800bcb0 con 0x7f14fc0cca90 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14e8004d50 0x7f14e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15020df640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14e80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15018de640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8003f90 0x7f14e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 -- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 msgr2=0x7f14e80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14e80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 -- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8003f90 msgr2=0x7f14e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8003f90 0x7f14e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 -- 172.21.15.28:0/2751230156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e8003530 con 0x7f14e8004d50 2024-09-15T22:57:40.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15020df640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0cca90 0x7f14e80039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14e8004d50 0x7f14e80051d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14f4007360 tx=0x7f14f401f090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572bf4db310279f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40b4070 con 0x7f14e8004d50 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40af440 con 0x7f14e8004d50 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15010dd640 1 -- 172.21.15.28:0/2751230156 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4009be0 con 0x7f14e8004d50 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f1504343640 1 -- 172.21.15.28:0/2751230156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14e8004d50 msgr2=0x7f14e80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f1504343640 1 --2- 172.21.15.28:0/2751230156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14e8004d50 0x7f14e80051d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14f4007360 tx=0x7f14f401f090 comp rx=0 tx=0).stop 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f15028e0640 1 -- 172.21.15.28:0/2751230156 reap_dead start 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f1504343640 1 -- 172.21.15.28:0/2751230156 shutdown_connections 2024-09-15T22:57:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f1504343640 1 -- 172.21.15.28:0/2751230156 >> 172.21.15.28:0/2751230156 conn(0x7f14fc06bcc0 msgr2=0x7f14fc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.245+0000 7f1504343640 1 -- 172.21.15.28:0/2751230156 shutdown_connections 2024-09-15T22:57:40.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- 172.21.15.28:0/2751230156 wait complete. 2024-09-15T22:57:40.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 Processor -- start 2024-09-15T22:57:40.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- start start 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8004d50 0x7f14fc152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0720f0 0x7f14fc072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc0cd8c0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc0cd5e0 con 0x7f14e8004d50 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f14fc15c0b0 con 0x7f14fc0720f0 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59286/0 (socket says 172.21.15.28:59286) 2024-09-15T22:57:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 -- 172.21.15.28:0/1934922080 learned_addr learned my addr 172.21.15.28:0/1934922080 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15020df640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8004d50 0x7f14fc152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15018de640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0720f0 0x7f14fc072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 -- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0720f0 msgr2=0x7f14fc072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0720f0 0x7f14fc072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 -- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8004d50 msgr2=0x7f14fc152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8004d50 0x7f14fc152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 -- 172.21.15.28:0/1934922080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc0cb0c0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f15028e0640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14f40b2040 tx=0x7f14e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40b4070 con 0x7f14fc0c84c0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40b6070 con 0x7f14fc0c84c0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14fc0cb3a0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4009be0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.249+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14fc0cb960 con 0x7f14fc0c84c0 2024-09-15T22:57:40.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14fc15d640 con 0x7f14fc0c84c0 2024-09-15T22:57:40.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14f40ad790 con 0x7f14fc0c84c0 2024-09-15T22:57:40.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f14f2ffd640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 0x7f14e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f14f4120bc0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f15020df640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 0x7f14e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.253+0000 7f15020df640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 0x7f14e0069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14ec001ec0 tx=0x7f14ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.257+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f14f4018da0 con 0x7f14fc0c84c0 2024-09-15T22:57:40.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14fc06da10 con 0x7f14fc0c84c0 2024-09-15T22:57:40.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f14f2ffd640 1 -- 172.21.15.28:0/1934922080 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5231 (secure 0 0 0) 0x7f14f40f1440 con 0x7f14fc0c84c0 2024-09-15T22:57:40.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:40.460 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"btime":"2024-09-15T22:57:21:976822+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:06.757699+0000","modified":"2024-09-15T22:57:21.329043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4806},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4806":{"gid":4806,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2539404134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2539404134},{"type":"v1","addr":"172.21.15.28:6835","nonce":2539404134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4806,"qdb_cluster":[4806]},"id":2}]} 2024-09-15T22:57:40.460 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 17 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 msgr2=0x7f14e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 0x7f14e0069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14ec001ec0 tx=0x7f14ec009040 comp rx=0 tx=0).stop 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 msgr2=0x7f14fc0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.457+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14f40b2040 tx=0x7f14e8005840 comp rx=0 tx=0).stop 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 shutdown_connections 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14fc0c84c0 0x7f14fc0c8940 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f14fc0720f0 0x7f14fc072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f14e00678f0 0x7f14e0069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 --2- 172.21.15.28:0/1934922080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14e8004d50 0x7f14fc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 >> 172.21.15.28:0/1934922080 conn(0x7f14fc06bcc0 msgr2=0x7f14fc0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 shutdown_connections 2024-09-15T22:57:40.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.461+0000 7f1504343640 1 -- 172.21.15.28:0/1934922080 wait complete. 2024-09-15T22:57:40.478 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:40.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 Processor -- start 2024-09-15T22:57:40.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 -- start start 2024-09-15T22:57:40.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71c815e820 0x7f71c80cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c806e190 con 0x7f71c80b3610 2024-09-15T22:57:40.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f71c80d2ba0 con 0x7f71c815e820 2024-09-15T22:57:40.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71cce97640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f71c80d2e80 con 0x7f71c806d870 2024-09-15T22:57:40.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c659c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71c815e820 0x7f71c80cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c6d9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f71c80b3610 0x7f71c80d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:58538/0 (socket says 172.21.15.28:58538) 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c6d9d640 1 -- 172.21.15.28:0/3691035459 learned_addr learned my addr 172.21.15.28:0/3691035459 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c659c640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:37422/0 (socket says 172.21.15.28:37422) 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/3691035459 >> v2:172.21.15.131:3300/0 conn(0x7f71c815e820 0x7f71c80cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:38632/0 (socket says 172.21.15.28:38632) 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 -- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 msgr2=0x7f71c806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 -- 172.21.15.28:0/3691035459 >> v1:172.21.15.131:6789/0 conn(0x7f71c80b3610 legacy=0x7f71c80d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c5d9b640 1 -- 172.21.15.28:0/3691035459 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c80d3160 con 0x7f71c815e820 2024-09-15T22:57:40.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.589+0000 7f71c659c640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:40.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c815e820 0x7f71c80cf750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097c0 tx=0x7f71bc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d442203331ab3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c559a640 1 -- 172.21.15.28:0/3691035459 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0a7070 con 0x7f71c815e820 2024-09-15T22:57:40.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c559a640 1 -- 172.21.15.28:0/3691035459 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc0b0070 con 0x7f71c815e820 2024-09-15T22:57:40.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c559a640 1 -- 172.21.15.28:0/3691035459 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0ab890 con 0x7f71c815e820 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c815e820 msgr2=0x7f71c80cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c815e820 0x7f71c80cf750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097c0 tx=0x7f71bc01c470 comp rx=0 tx=0).stop 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- 172.21.15.28:0/3691035459 shutdown_connections 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c815e820 0x7f71c80cf750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- 172.21.15.28:0/3691035459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c806d870 0x7f71c806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- 172.21.15.28:0/3691035459 >> 172.21.15.28:0/3691035459 conn(0x7f71c80d4910 msgr2=0x7f71c80d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- 172.21.15.28:0/3691035459 shutdown_connections 2024-09-15T22:57:40.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- 172.21.15.28:0/3691035459 wait complete. 2024-09-15T22:57:40.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 Processor -- start 2024-09-15T22:57:40.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- start start 2024-09-15T22:57:40.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c806d870 0x7f71c81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c815e820 0x7f71c814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71c816b1a0 con 0x7f71c80b3610 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f71c80d4350 con 0x7f71c806d870 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71cce97640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f71c816b320 con 0x7f71c815e820 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59288/0 (socket says 172.21.15.28:59288) 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.593+0000 7f71c5d9b640 1 -- 172.21.15.28:0/4218025949 learned_addr learned my addr 172.21.15.28:0/4218025949 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c659c640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c806d870 0x7f71c81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c6d9d640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c815e820 0x7f71c814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 -- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c815e820 msgr2=0x7f71c814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c815e820 0x7f71c814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 -- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c806d870 msgr2=0x7f71c81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c806d870 0x7f71c81561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 -- 172.21.15.28:0/4218025949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c80b9500 con 0x7f71c80b3610 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c5d9b640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f71bc01cd10 tx=0x7f71bc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0abb70 con 0x7f71c80b3610 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc0abd50 con 0x7f71c80b3610 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c81567b0 con 0x7f71c80b3610 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0be630 con 0x7f71c80b3610 2024-09-15T22:57:40.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c8158de0 con 0x7f71c80b3610 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c806dc50 con 0x7f71c80b3610 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71bc0b43f0 con 0x7f71c80b3610 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 0x7f71a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f71bc11ff60 con 0x7f71c80b3610 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c659c640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 0x7f71a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.597+0000 7f71c659c640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 0x7f71a8069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009580 tx=0x7f71b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.601+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71bc016090 con 0x7f71c80b3610 2024-09-15T22:57:40.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.761+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71c80d3e90 con 0x7f71c80b3610 2024-09-15T22:57:40.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.761+0000 7f71b6ffd640 1 -- 172.21.15.28:0/4218025949 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+18577 (secure 0 0 0) 0x7f71bc0f0890 con 0x7f71c80b3610 2024-09-15T22:57:40.765 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:40.765 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":34,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:22.978741+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:04.684893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:05.747115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-09-15T22:57:20.775343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 msgr2=0x7f71a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 0x7f71a8069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009580 tx=0x7f71b8008040 comp rx=0 tx=0).stop 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 msgr2=0x7f71c80b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f71bc01cd10 tx=0x7f71bc019210 comp rx=0 tx=0).stop 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 shutdown_connections 2024-09-15T22:57:40.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71c815e820 0x7f71c814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c80b3610 0x7f71c80b8fc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f71a80678c0 0x7f71a8069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 --2- 172.21.15.28:0/4218025949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71c806d870 0x7f71c81561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 >> 172.21.15.28:0/4218025949 conn(0x7f71c80d4910 msgr2=0x7f71c80b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 shutdown_connections 2024-09-15T22:57:40.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.765+0000 7f71cce97640 1 -- 172.21.15.28:0/4218025949 wait complete. 2024-09-15T22:57:40.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:57:40.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 Processor -- start 2024-09-15T22:57:40.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 -- start start 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3aa415c290 0x7f3aa40cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 0x7f3aa40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa4160220 con 0x7f3aa406bcc0 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa4160500 con 0x7f3aa415c290 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aaa221640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa41607e0 con 0x7f3aa415fd20 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3aa415c290 0x7f3aa40cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3aa415c290 0x7f3aa40cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59290/0 (socket says 172.21.15.28:59290) 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 -- 172.21.15.28:0/501239492 learned_addr learned my addr 172.21.15.28:0/501239492 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:40.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 -- 172.21.15.28:0/501239492 >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 msgr2=0x7f3aa40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3a9affd640 1 --2- 172.21.15.28:0/501239492 >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 0x7f3aa40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 --2- 172.21.15.28:0/501239492 >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 0x7f3aa40d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 -- 172.21.15.28:0/501239492 >> v1:172.21.15.131:6789/0 conn(0x7f3aa406bcc0 legacy=0x7f3aa406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:40.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3aa37fe640 1 -- 172.21.15.28:0/501239492 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa4160ac0 con 0x7f3aa415c290 2024-09-15T22:57:40.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.905+0000 7f3a9affd640 1 --2- 172.21.15.28:0/501239492 >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 0x7f3aa40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:40.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aa37fe640 1 --2- 172.21.15.28:0/501239492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa40cedf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406e5a0 tx=0x7f3a9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2935781dc5ec7e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aa2ffd640 1 -- 172.21.15.28:0/501239492 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940b0070 con 0x7f3aa415c290 2024-09-15T22:57:40.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aa2ffd640 1 -- 172.21.15.28:0/501239492 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a940ab600 con 0x7f3aa415c290 2024-09-15T22:57:40.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aa2ffd640 1 -- 172.21.15.28:0/501239492 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940ab9d0 con 0x7f3aa415c290 2024-09-15T22:57:40.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- 172.21.15.28:0/501239492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 msgr2=0x7f3aa40cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 --2- 172.21.15.28:0/501239492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa40cedf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406e5a0 tx=0x7f3a9401c450 comp rx=0 tx=0).stop 2024-09-15T22:57:40.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- 172.21.15.28:0/501239492 shutdown_connections 2024-09-15T22:57:40.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 --2- 172.21.15.28:0/501239492 >> v2:172.21.15.131:3300/0 conn(0x7f3aa415fd20 0x7f3aa40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 --2- 172.21.15.28:0/501239492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa40cedf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- 172.21.15.28:0/501239492 >> 172.21.15.28:0/501239492 conn(0x7f3aa4067bd0 msgr2=0x7f3aa406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:40.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- 172.21.15.28:0/501239492 shutdown_connections 2024-09-15T22:57:40.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- 172.21.15.28:0/501239492 wait complete. 2024-09-15T22:57:40.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 Processor -- start 2024-09-15T22:57:40.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.909+0000 7f3aaa221640 1 -- start start 2024-09-15T22:57:40.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aa406bcc0 0x7f3aa415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 0x7f3aa414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa415d250 con 0x7f3aa415c290 2024-09-15T22:57:40.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa415d0d0 con 0x7f3aa406bcc0 2024-09-15T22:57:40.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa415d3d0 con 0x7f3aa415fd20 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59300/0 (socket says 172.21.15.28:59300) 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 -- 172.21.15.28:0/726545551 learned_addr learned my addr 172.21.15.28:0/726545551 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa37fe640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aa406bcc0 0x7f3aa415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa3fff640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 0x7f3aa414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 -- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 msgr2=0x7f3aa414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 0x7f3aa414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 -- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aa406bcc0 msgr2=0x7f3aa415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aa406bcc0 0x7f3aa415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 -- 172.21.15.28:0/726545551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa4154140 con 0x7f3aa415c290 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa3fff640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 0x7f3aa414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:40.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3a9affd640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c7f0 tx=0x7f3a8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c015070 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c004220 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa41543e0 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c003620 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa41503b0 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa41547d0 con 0x7f3aa415c290 2024-09-15T22:57:40.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a8c0037c0 con 0x7f3aa415c290 2024-09-15T22:57:40.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 0x7f3a84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:40.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f3a8c085c40 con 0x7f3aa415c290 2024-09-15T22:57:40.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.913+0000 7f3aa37fe640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 0x7f3a84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:40.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.917+0000 7f3aa37fe640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 0x7f3a84069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ad000 tx=0x7f3a940a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:40.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:40.921+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3a8c055f00 con 0x7f3aa415c290 2024-09-15T22:57:41.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.121+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3aa40d0570 con 0x7f3aa415c290 2024-09-15T22:57:41.125 INFO:tasks.ceph.mon.a.smithi028.stderr:2024-09-15T22:57:41.121+0000 7f45fbb49640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:57:41.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.125+0000 7f3aa0ff9640 1 -- 172.21.15.28:0/726545551 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f3a8c05a200 con 0x7f3aa415c290 2024-09-15T22:57:41.127 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:57:41.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 msgr2=0x7f3a84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:41.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 0x7f3a84069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ad000 tx=0x7f3a940a6000 comp rx=0 tx=0).stop 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 msgr2=0x7f3aa4151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c7f0 tx=0x7f3a8c00ccb0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 shutdown_connections 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aa415fd20 0x7f3aa414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3aa415c290 0x7f3aa4151180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f3a840678c0 0x7f3a84069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 --2- 172.21.15.28:0/726545551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aa406bcc0 0x7f3aa415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 >> 172.21.15.28:0/726545551 conn(0x7f3aa4067bd0 msgr2=0x7f3aa40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:41.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 shutdown_connections 2024-09-15T22:57:41.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.129+0000 7f3aaa221640 1 -- 172.21.15.28:0/726545551 wait complete. 2024-09-15T22:57:41.134 INFO:tasks.ceph.mds.c.smithi028.stderr: -3369> 2024-09-15T22:57:11.346+0000 7f304bded640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:57:41.149 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:57:41.173 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2024-09-15T22:57:41.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 Processor -- start 2024-09-15T22:57:41.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 -- start start 2024-09-15T22:57:41.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa078145b20 0x7fa078072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078072860 0x7fa0780b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa0780b2370 0x7fa07815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa078072ca0 con 0x7fa078145b20 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa0780b27c0 con 0x7fa0780b2370 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa0804a0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa078073a40 con 0x7fa078072860 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa078145b20 0x7fa078072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa078145b20 0x7fa078072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59340/0 (socket says 172.21.15.28:59340) 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 -- 172.21.15.28:0/1305592122 learned_addr learned my addr 172.21.15.28:0/1305592122 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07ea3d640 1 --2- 172.21.15.28:0/1305592122 >> v2:172.21.15.131:3300/0 conn(0x7fa0780b2370 0x7fa07815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07da3b640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078072860 0x7fa0780b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 -- 172.21.15.28:0/1305592122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078072860 msgr2=0x7fa0780b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078072860 0x7fa0780b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 -- 172.21.15.28:0/1305592122 >> v2:172.21.15.131:3300/0 conn(0x7fa0780b2370 msgr2=0x7fa07815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 --2- 172.21.15.28:0/1305592122 >> v2:172.21.15.131:3300/0 conn(0x7fa0780b2370 0x7fa07815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.261+0000 7fa07e23c640 1 -- 172.21.15.28:0/1305592122 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa078072ec0 con 0x7fa078145b20 2024-09-15T22:57:41.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa07e23c640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078145b20 0x7fa078072320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0780d1190 tx=0x7fa06801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966378ff5fae1e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:41.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa07d23a640 1 -- 172.21.15.28:0/1305592122 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b0070 con 0x7fa078145b20 2024-09-15T22:57:41.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa07d23a640 1 -- 172.21.15.28:0/1305592122 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0680ab600 con 0x7fa078145b20 2024-09-15T22:57:41.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa07d23a640 1 -- 172.21.15.28:0/1305592122 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ab9d0 con 0x7fa078145b20 2024-09-15T22:57:41.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- 172.21.15.28:0/1305592122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078145b20 msgr2=0x7fa078072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:41.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078145b20 0x7fa078072320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0780d1190 tx=0x7fa06801c1a0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- 172.21.15.28:0/1305592122 shutdown_connections 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 --2- 172.21.15.28:0/1305592122 >> v2:172.21.15.131:3300/0 conn(0x7fa0780b2370 0x7fa07815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078072860 0x7fa0780b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 --2- 172.21.15.28:0/1305592122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078145b20 0x7fa078072320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- 172.21.15.28:0/1305592122 >> 172.21.15.28:0/1305592122 conn(0x7fa07806bcc0 msgr2=0x7fa07806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- 172.21.15.28:0/1305592122 shutdown_connections 2024-09-15T22:57:41.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- 172.21.15.28:0/1305592122 wait complete. 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 Processor -- start 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.265+0000 7fa0804a0640 1 -- start start 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0780b2370 0x7fa078144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 0x7fa0780ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa078145f00 con 0x7fa078072860 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780ccda0 con 0x7fa0780b2370 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa078146080 con 0x7fa078145b20 2024-09-15T22:57:41.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59354/0 (socket says 172.21.15.28:59354) 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 -- 172.21.15.28:0/2670399802 learned_addr learned my addr 172.21.15.28:0/2670399802 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07da3b640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0780b2370 0x7fa078144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07ea3d640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 0x7fa0780ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 -- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 msgr2=0x7fa0780ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 0x7fa0780ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 -- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0780b2370 msgr2=0x7fa078144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0780b2370 0x7fa078144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 -- 172.21.15.28:0/2670399802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0780724e0 con 0x7fa078072860 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07ea3d640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 0x7fa0780ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07e23c640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa06801a850 tx=0x7fa068018f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:41.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b0040 con 0x7fa078072860 2024-09-15T22:57:41.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0680b4620 con 0x7fa078072860 2024-09-15T22:57:41.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0781f7c80 con 0x7fa078072860 2024-09-15T22:57:41.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b4a10 con 0x7fa078072860 2024-09-15T22:57:41.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa078145300 con 0x7fa078072860 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa078069220 con 0x7fa078072860 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0680ab4c0 con 0x7fa078072860 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 0x7fa05c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7fa06811fa40 con 0x7fa078072860 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07da3b640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 0x7fa05c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:41.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.269+0000 7fa07da3b640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 0x7fa05c069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cf1c0 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:41.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.273+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa068016110 con 0x7fa078072860 2024-09-15T22:57:41.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:41.469+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa07815ff90 con 0x7fa078072860 2024-09-15T22:57:42.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.133+0000 7fa06effd640 1 -- 172.21.15.28:0/2670399802 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fa06811f020 con 0x7fa078072860 2024-09-15T22:57:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 msgr2=0x7fa05c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 0x7fa05c069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cf1c0 tx=0x7fa074008040 comp rx=0 tx=0).stop 2024-09-15T22:57:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 msgr2=0x7fa078159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa06801a850 tx=0x7fa068018f40 comp rx=0 tx=0).stop 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 shutdown_connections 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa078145b20 0x7fa0780ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa05c0678f0 0x7fa05c069db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0780b2370 0x7fa078144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 --2- 172.21.15.28:0/2670399802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa078072860 0x7fa078159fa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 >> 172.21.15.28:0/2670399802 conn(0x7fa07806bcc0 msgr2=0x7fa07815e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 shutdown_connections 2024-09-15T22:57:42.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.137+0000 7fa0804a0640 1 -- 172.21.15.28:0/2670399802 wait complete. 2024-09-15T22:57:42.159 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:57:42.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 Processor -- start 2024-09-15T22:57:42.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 -- start start 2024-09-15T22:57:42.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efe640cff80 0x7efe640d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:42.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe640ce0c0 con 0x7efe640ccc50 2024-09-15T22:57:42.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe640ce3a0 con 0x7efe64158ca0 2024-09-15T22:57:42.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe68bdc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7efe640af740 con 0x7efe640cff80 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe61d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efe640cff80 0x7efe640d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe62d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efe640ccc50 0x7efe640cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38952/0 (socket says 172.21.15.28:38952) 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe61d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efe640cff80 0x7efe640d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59368/0 (socket says 172.21.15.28:59368) 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe62d9d640 1 -- 172.21.15.28:0/2188415082 learned_addr learned my addr 172.21.15.28:0/2188415082 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe61d9b640 1 -- 172.21.15.28:0/2188415082 >> v1:172.21.15.131:6789/0 conn(0x7efe64158ca0 legacy=0x7efe640af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe61d9b640 1 -- 172.21.15.28:0/2188415082 >> v1:172.21.15.28:6789/0 conn(0x7efe640ccc50 legacy=0x7efe640cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.333+0000 7efe61d9b640 1 -- 172.21.15.28:0/2188415082 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640ce680 con 0x7efe640cff80 2024-09-15T22:57:42.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe61d9b640 1 --2- 172.21.15.28:0/2188415082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640cff80 0x7efe640d03c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef289e2aeab180e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:42.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe6159a640 1 -- 172.21.15.28:0/2188415082 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540b2070 con 0x7efe640cff80 2024-09-15T22:57:42.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe6159a640 1 -- 172.21.15.28:0/2188415082 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe540a5710 con 0x7efe640cff80 2024-09-15T22:57:42.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe6159a640 1 -- 172.21.15.28:0/2188415082 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540a5ae0 con 0x7efe640cff80 2024-09-15T22:57:42.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 -- 172.21.15.28:0/2188415082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640cff80 msgr2=0x7efe640d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 --2- 172.21.15.28:0/2188415082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640cff80 0x7efe640d03c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5401c850 comp rx=0 tx=0).stop 2024-09-15T22:57:42.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 -- 172.21.15.28:0/2188415082 shutdown_connections 2024-09-15T22:57:42.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 --2- 172.21.15.28:0/2188415082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640cff80 0x7efe640d03c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 -- 172.21.15.28:0/2188415082 >> 172.21.15.28:0/2188415082 conn(0x7efe6406bcc0 msgr2=0x7efe6406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:42.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 -- 172.21.15.28:0/2188415082 shutdown_connections 2024-09-15T22:57:42.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.337+0000 7efe68bdc640 1 -- 172.21.15.28:0/2188415082 wait complete. 2024-09-15T22:57:42.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 Processor -- start 2024-09-15T22:57:42.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- start start 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe640cff80 0x7efe64072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe64158ca0 0x7efe6414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe640aeb80 con 0x7efe640ccc50 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efe640aea00 con 0x7efe640cff80 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efe640b3540 con 0x7efe64158ca0 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59378/0 (socket says 172.21.15.28:59378) 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 -- 172.21.15.28:0/4003476666 learned_addr learned my addr 172.21.15.28:0/4003476666 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe61d9b640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe640cff80 0x7efe64072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe62d9d640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe64158ca0 0x7efe6414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:42.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 -- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe64158ca0 msgr2=0x7efe6414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe64158ca0 0x7efe6414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 -- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe640cff80 msgr2=0x7efe64072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe640cff80 0x7efe64072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 -- 172.21.15.28:0/4003476666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640721e0 con 0x7efe640ccc50 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe6259c640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c3c0 tx=0x7efe4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c017070 con 0x7efe640ccc50 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4c0052d0 con 0x7efe640ccc50 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe640724c0 con 0x7efe640ccc50 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c003840 con 0x7efe640ccc50 2024-09-15T22:57:42.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe64144f30 con 0x7efe640ccc50 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe64069220 con 0x7efe640ccc50 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe4c01a070 con 0x7efe640ccc50 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 0x7efe44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe61d9b640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 0x7efe44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.341+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7efe4c085190 con 0x7efe640ccc50 2024-09-15T22:57:42.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.345+0000 7efe61d9b640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 0x7efe44069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe540af000 tx=0x7efe540a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:42.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.349+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe4c005480 con 0x7efe640ccc50 2024-09-15T22:57:42.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:42.505+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efe640d03c0 con 0x7efe640ccc50 2024-09-15T22:57:43.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.133+0000 7efe5affd640 1 -- 172.21.15.28:0/4003476666 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7efe4c055b60 con 0x7efe640ccc50 2024-09-15T22:57:43.137 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 msgr2=0x7efe44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 0x7efe44069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe540af000 tx=0x7efe540a7070 comp rx=0 tx=0).stop 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 msgr2=0x7efe641449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c3c0 tx=0x7efe4c00c880 comp rx=0 tx=0).stop 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 shutdown_connections 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe64158ca0 0x7efe6414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efe440678c0 0x7efe44069d80 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe540af000 tx=0x7efe540a7070 comp rx=0 tx=0).stop 2024-09-15T22:57:43.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe640cff80 0x7efe64072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 --2- 172.21.15.28:0/4003476666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe640ccc50 0x7efe641449f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 >> 172.21.15.28:0/4003476666 conn(0x7efe6406bcc0 msgr2=0x7efe640aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 shutdown_connections 2024-09-15T22:57:43.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.141+0000 7efe68bdc640 1 -- 172.21.15.28:0/4003476666 wait complete. 2024-09-15T22:57:43.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:57:43.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 Processor -- start 2024-09-15T22:57:43.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 -- start start 2024-09-15T22:57:43.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f877815c3c0 0x7f87780b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f877806c3d0 0x7f87780cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87780cdd80 con 0x7f87780d1d60 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f87780b47f0 con 0x7f877806c3d0 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877e3cb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f87780b5630 con 0x7f877815c3c0 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f877806c3d0 0x7f87780cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f877806c3d0 0x7f87780cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52344/0 (socket says 172.21.15.28:52344) 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 -- 172.21.15.28:0/332123595 learned_addr learned my addr 172.21.15.28:0/332123595 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f8777fff640 1 --2- 172.21.15.28:0/332123595 >> v2:172.21.15.131:3300/0 conn(0x7f877815c3c0 0x7f87780b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 -- 172.21.15.28:0/332123595 >> v2:172.21.15.131:3300/0 conn(0x7f877815c3c0 msgr2=0x7f87780b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 --2- 172.21.15.28:0/332123595 >> v2:172.21.15.131:3300/0 conn(0x7f877815c3c0 0x7f87780b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 -- 172.21.15.28:0/332123595 >> v1:172.21.15.131:6789/0 conn(0x7f87780d1d60 legacy=0x7f877806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:43.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.305+0000 7f877c968640 1 -- 172.21.15.28:0/332123595 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87780b4a20 con 0x7f877806c3d0 2024-09-15T22:57:43.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877c968640 1 --2- 172.21.15.28:0/332123595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87780cf080 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8778068b30 tx=0x7f877001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781089f52b6244de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:43.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f8776ffd640 1 -- 172.21.15.28:0/332123595 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5840 con 0x7f877806c3d0 2024-09-15T22:57:43.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f8776ffd640 1 -- 172.21.15.28:0/332123595 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87700a59e0 con 0x7f877806c3d0 2024-09-15T22:57:43.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f8776ffd640 1 -- 172.21.15.28:0/332123595 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5db0 con 0x7f877806c3d0 2024-09-15T22:57:43.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- 172.21.15.28:0/332123595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 msgr2=0x7f87780cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:43.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- 172.21.15.28:0/332123595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87780cf080 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8778068b30 tx=0x7f877001c980 comp rx=0 tx=0).stop 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- 172.21.15.28:0/332123595 shutdown_connections 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- 172.21.15.28:0/332123595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87780cf080 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- 172.21.15.28:0/332123595 >> v2:172.21.15.131:3300/0 conn(0x7f877815c3c0 0x7f87780b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- 172.21.15.28:0/332123595 >> 172.21.15.28:0/332123595 conn(0x7f87780d1240 msgr2=0x7f87780d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- 172.21.15.28:0/332123595 shutdown_connections 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- 172.21.15.28:0/332123595 wait complete. 2024-09-15T22:57:43.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 Processor -- start 2024-09-15T22:57:43.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- start start 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87780d1d60 0x7f8778157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 0x7f8778150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f87780cfdd0 con 0x7f877806c3d0 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f877815c7a0 con 0x7f877815c3c0 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.309+0000 7f877e3cb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87780cff50 con 0x7f87780d1d60 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52354/0 (socket says 172.21.15.28:52354) 2024-09-15T22:57:43.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 -- 172.21.15.28:0/1675644405 learned_addr learned my addr 172.21.15.28:0/1675644405 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f877c968640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 0x7f8778150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f87777fe640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87780d1d60 0x7f8778157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 -- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87780d1d60 msgr2=0x7f8778157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87780d1d60 0x7f8778157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 -- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 msgr2=0x7f8778150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 0x7f8778150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 -- 172.21.15.28:0/1675644405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8778158a40 con 0x7f877806c3d0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f877c968640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 0x7f8778150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8777fff640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f876800d620 tx=0x7f876800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876800b620 con 0x7f877806c3d0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8768019070 con 0x7f877806c3d0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87781573d0 con 0x7f877806c3d0 2024-09-15T22:57:43.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876800b9e0 con 0x7f877806c3d0 2024-09-15T22:57:43.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8778150840 con 0x7f877806c3d0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87780cf080 con 0x7f877806c3d0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f876800bb80 con 0x7f877806c3d0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 0x7f8764069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5752+0+0 (secure 0 0 0) 0x7f87680860a0 con 0x7f877806c3d0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f87777fe640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 0x7f8764069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.313+0000 7f87777fe640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 0x7f8764069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8778158480 tx=0x7f876c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:43.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.317+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8768056bb0 con 0x7f877806c3d0 2024-09-15T22:57:43.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:43.485+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f877806c0b0 con 0x7f877806c3d0 2024-09-15T22:57:44.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.141+0000 7f8774ff9640 1 -- 172.21.15.28:0/1675644405 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f87680564b0 con 0x7f877806c3d0 2024-09-15T22:57:44.146 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-09-15T22:57:44.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 msgr2=0x7f8764069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 0x7f8764069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8778158480 tx=0x7f876c009040 comp rx=0 tx=0).stop 2024-09-15T22:57:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 msgr2=0x7f87781598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f876800d620 tx=0x7f876800dae0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 shutdown_connections 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87640678f0 0x7f8764069db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f877815c3c0 0x7f8778150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87780d1d60 0x7f8778157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 --2- 172.21.15.28:0/1675644405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f877806c3d0 0x7f87781598b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 >> 172.21.15.28:0/1675644405 conn(0x7f87780d1240 msgr2=0x7f8778156090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 shutdown_connections 2024-09-15T22:57:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.149+0000 7f877e3cb640 1 -- 172.21.15.28:0/1675644405 wait complete. 2024-09-15T22:57:44.181 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-09-15T22:57:44.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 Processor -- start 2024-09-15T22:57:44.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 -- start start 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd174155a40 0x7fd1740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd1740d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17415c0c0 con 0x7fd1740d0560 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd1740ce1a0 con 0x7fd174155a40 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd1791f1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd17415c3a0 con 0x7fd17415b8d0 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd1740d0560 0x7fd17406cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43976/0 (socket says 172.21.15.28:43976) 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 -- 172.21.15.28:0/719517546 learned_addr learned my addr 172.21.15.28:0/719517546 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17259c640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd1740d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692868157 0 0) 0x7fd17415c0c0 con 0x7fd1740d0560 2024-09-15T22:57:44.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd172d9d640 1 --2- 172.21.15.28:0/719517546 >> v2:172.21.15.131:3300/0 conn(0x7fd174155a40 0x7fd1740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd15c003530 con 0x7fd1740d0560 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1301897761 0 0) 0x7fd15c003530 con 0x7fd1740d0560 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 msgr2=0x7fd1740d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd1740d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 >> v2:172.21.15.131:3300/0 conn(0x7fd174155a40 msgr2=0x7fd1740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 --2- 172.21.15.28:0/719517546 >> v2:172.21.15.131:3300/0 conn(0x7fd174155a40 0x7fd1740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17415c680 con 0x7fd1740d0560 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd16c001a00 con 0x7fd1740d0560 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 >> v1:172.21.15.28:6789/0 conn(0x7fd1740d0560 legacy=0x7fd17406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd15c0039c0 0x7fd15c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd15c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd15c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740ce1a0 con 0x7fd15c004d50 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd17415c3a0 con 0x7fd15c0039c0 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c00b9d0 con 0x7fd17415b8d0 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd15c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17259c640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd15c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 -- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 msgr2=0x7fd15c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd15c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 -- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd15c0039c0 msgr2=0x7fd15c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd15c0039c0 0x7fd15c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17359e640 1 -- 172.21.15.28:0/719517546 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c003530 con 0x7fd15c004d50 2024-09-15T22:57:44.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.301+0000 7fd17259c640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd17415b8d0 0x7fd15c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:44.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd17359e640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd15c0051d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00a8b0 tx=0x7fd16c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fed75ea5e0546c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:44.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00a4a0 con 0x7fd15c004d50 2024-09-15T22:57:44.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c0ad630 con 0x7fd15c004d50 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd171d9b640 1 -- 172.21.15.28:0/719517546 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0ada20 con 0x7fd15c004d50 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- 172.21.15.28:0/719517546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 msgr2=0x7fd15c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 --2- 172.21.15.28:0/719517546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd15c0051d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00a8b0 tx=0x7fd16c01d3a0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd17359e640 1 -- 172.21.15.28:0/719517546 reap_dead start 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- 172.21.15.28:0/719517546 shutdown_connections 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- 172.21.15.28:0/719517546 >> 172.21.15.28:0/719517546 conn(0x7fd17406bcc0 msgr2=0x7fd17406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- 172.21.15.28:0/719517546 shutdown_connections 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- 172.21.15.28:0/719517546 wait complete. 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 Processor -- start 2024-09-15T22:57:44.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.305+0000 7fd1791f1640 1 -- start start 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd174142ef0 0x7fd174143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1741f7d90 0x7fd1741f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740cf7c0 con 0x7fd15c004d50 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740cf640 con 0x7fd1741f7d90 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd1740cf940 con 0x7fd174142ef0 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52378/0 (socket says 172.21.15.28:52378) 2024-09-15T22:57:44.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 -- 172.21.15.28:0/4039572198 learned_addr learned my addr 172.21.15.28:0/4039572198 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 -- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd174142ef0 msgr2=0x7fd174143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd174142ef0 0x7fd174143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 -- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1741f7d90 msgr2=0x7fd1741f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1741f7d90 0x7fd1741f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 -- 172.21.15.28:0/4039572198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1741438b0 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd172d9d640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd1640086c0 tx=0x7fd164009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16401b070 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164004030 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1741f8750 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164004420 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd174143e20 con 0x7fd15c004d50 2024-09-15T22:57:44.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd174069220 con 0x7fd15c004d50 2024-09-15T22:57:44.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16401e070 con 0x7fd15c004d50 2024-09-15T22:57:44.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 0x7fd160069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:44.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5338+0+0 (secure 0 0 0) 0x7fd164085c30 con 0x7fd15c004d50 2024-09-15T22:57:44.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd17259c640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 0x7fd160069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:44.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.309+0000 7fd17259c640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 0x7fd160069db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd17415e9b0 tx=0x7fd168008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.313+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd164056840 con 0x7fd15c004d50 2024-09-15T22:57:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:44.477+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1740b1710 con 0x7fd15c004d50 2024-09-15T22:57:45.113 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:57:45.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:57:45.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.145+0000 7fd15b7fe640 1 -- 172.21.15.28:0/4039572198 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v38) ==== 160+0+0 (secure 0 0 0) 0x7fd164056140 con 0x7fd15c004d50 2024-09-15T22:57:45.148 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'data_new' removed 2024-09-15T22:57:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 msgr2=0x7fd160069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 0x7fd160069db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd17415e9b0 tx=0x7fd168008040 comp rx=0 tx=0).stop 2024-09-15T22:57:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 msgr2=0x7fd17415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd1640086c0 tx=0x7fd164009330 comp rx=0 tx=0).stop 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 shutdown_connections 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd1600678f0 0x7fd160069db0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd17415e9b0 tx=0x7fd168008040 comp rx=0 tx=0).stop 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1741f7d90 0x7fd1741f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd174142ef0 0x7fd174143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 --2- 172.21.15.28:0/4039572198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd15c004d50 0x7fd17415a6b0 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd1640086c0 tx=0x7fd164009330 comp rx=0 tx=0).stop 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 >> 172.21.15.28:0/4039572198 conn(0x7fd17406bcc0 msgr2=0x7fd1740b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 shutdown_connections 2024-09-15T22:57:45.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.149+0000 7fd1791f1640 1 -- 172.21.15.28:0/4039572198 wait complete. 2024-09-15T22:57:45.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:57:45.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.345+0000 7fcf0b97e640 1 Processor -- start 2024-09-15T22:57:45.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.345+0000 7fcf0b97e640 1 -- start start 2024-09-15T22:57:45.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf0b97e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 0x7fcf040b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf0b97e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040d2cc0 con 0x7fcf0415ea00 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf0b97e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040d2fa0 con 0x7fcf040d2830 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf0b97e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040d3280 con 0x7fcf0415e620 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcf0415ea00 0x7fcf040b76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43988/0 (socket says 172.21.15.28:43988) 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 -- 172.21.15.28:0/1149646122 learned_addr learned my addr 172.21.15.28:0/1149646122 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf0971a640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 0x7fcf040b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494366759 0 0) 0x7fcf040d2cc0 con 0x7fcf0415ea00 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcef0003530 con 0x7fcf0415ea00 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3572506543 0 0) 0x7fcef0003530 con 0x7fcf0415ea00 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 msgr2=0x7fcf040b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 0x7fcf040b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 >> v1:172.21.15.131:6789/0 conn(0x7fcf040d2830 legacy=0x7fcf040d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040d3560 con 0x7fcf0415ea00 2024-09-15T22:57:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fcf00001a00 con 0x7fcf0415ea00 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 >> v1:172.21.15.28:6789/0 conn(0x7fcf0415ea00 legacy=0x7fcf040b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 0x7fcef00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcef0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcef0004d50 0x7fcef00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040d3280 con 0x7fcef0003fc0 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcef000bb10 con 0x7fcef0004d50 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcef000bd10 con 0x7fcf0415e620 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcef0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf09f1b640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcef0004d50 0x7fcef00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 -- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 msgr2=0x7fcef00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf0415e620 0x7fcef00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 -- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcef0004d50 msgr2=0x7fcef00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcef0004d50 0x7fcef00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 -- 172.21.15.28:0/1149646122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef0003530 con 0x7fcef0003fc0 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.349+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcef0004810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcf040b3cd0 tx=0x7fcf0001f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52004ab85a535d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000a3b0 con 0x7fcef0003fc0 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000b2070 con 0x7fcef0003fc0 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef7fff640 1 -- 172.21.15.28:0/1149646122 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000ad8e0 con 0x7fcef0003fc0 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1149646122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 msgr2=0x7fcef0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1149646122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcef0004810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcf040b3cd0 tx=0x7fcf0001f900 comp rx=0 tx=0).stop 2024-09-15T22:57:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf09f1b640 1 -- 172.21.15.28:0/1149646122 reap_dead start 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1149646122 shutdown_connections 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1149646122 >> 172.21.15.28:0/1149646122 conn(0x7fcf04067e00 msgr2=0x7fcf04068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1149646122 shutdown_connections 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1149646122 wait complete. 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 Processor -- start 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- start start 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf041f8220 0x7fcf04154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf04160fc0 0x7fcf04161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040d4fb0 con 0x7fcef0003fc0 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040d4e30 con 0x7fcf04160fc0 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040b33d0 con 0x7fcf041f8220 2024-09-15T22:57:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52402/0 (socket says 172.21.15.28:52402) 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 -- 172.21.15.28:0/1912223697 learned_addr learned my addr 172.21.15.28:0/1912223697 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf09f1b640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf04160fc0 0x7fcf04161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf041f8220 0x7fcf04154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 -- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf041f8220 msgr2=0x7fcf04154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf041f8220 0x7fcf04154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 -- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf04160fc0 msgr2=0x7fcf04161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf04160fc0 0x7fcf04161470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 -- 172.21.15.28:0/1912223697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04155190 con 0x7fcef0003fc0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0971a640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcef800e7f0 tx=0x7fcef800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8017070 con 0x7fcef0003fc0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef800c940 con 0x7fcef0003fc0 2024-09-15T22:57:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf04155470 con 0x7fcef0003fc0 2024-09-15T22:57:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef800cd30 con 0x7fcef0003fc0 2024-09-15T22:57:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.353+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf041561a0 con 0x7fcef0003fc0 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf040b3760 con 0x7fcef0003fc0 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcef801a070 con 0x7fcef0003fc0 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcef5ffb640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 0x7fcee8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcef8085bf0 con 0x7fcef0003fc0 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 0x7fcee8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.357+0000 7fcf08f19640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 0x7fcee8069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf000b1000 tx=0x7fcf000ab000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.361+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcef8056ac0 con 0x7fcef0003fc0 2024-09-15T22:57:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.517+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fcf040b9d00 con 0x7fcef0003fc0 2024-09-15T22:57:45.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcef5ffb640 1 -- 172.21.15.28:0/1912223697 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fcef80563c0 con 0x7fcef0003fc0 2024-09-15T22:57:45.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 msgr2=0x7fcee8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 0x7fcee8069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf000b1000 tx=0x7fcf000ab000 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 msgr2=0x7fcf04153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcef800e7f0 tx=0x7fcef800ecb0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 shutdown_connections 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcee80678c0 0x7fcee8069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf04160fc0 0x7fcf04161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf041f8220 0x7fcf04154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 --2- 172.21.15.28:0/1912223697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcef0003fc0 0x7fcf04153ba0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 >> 172.21.15.28:0/1912223697 conn(0x7fcf04067e00 msgr2=0x7fcf040d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 shutdown_connections 2024-09-15T22:57:45.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.525+0000 7fcf0b97e640 1 -- 172.21.15.28:0/1912223697 wait complete. 2024-09-15T22:57:45.545 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-09-15T22:57:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 Processor -- start 2024-09-15T22:57:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 -- start start 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdda80ceac0 0x7fdda80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda80d0960 con 0x7fdda80b24d0 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda80d0c40 con 0x7fdda8145970 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.653+0000 7fddadd0d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fdda80d0f20 con 0x7fdda80ceac0 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda6ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdda80b24d0 0x7fdda80cfc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43998/0 (socket says 172.21.15.28:43998) 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda6ffd640 1 -- 172.21.15.28:0/1732378909 learned_addr learned my addr 172.21.15.28:0/1732378909 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:45.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdda80ceac0 0x7fdda80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda67fc640 1 -- 172.21.15.28:0/1732378909 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129162891 0 0) 0x7fdda80d0960 con 0x7fdda80b24d0 2024-09-15T22:57:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda67fc640 1 -- 172.21.15.28:0/1732378909 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd90003530 con 0x7fdda80b24d0 2024-09-15T22:57:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda7fff640 1 -- 172.21.15.28:0/1732378909 >> v1:172.21.15.131:6789/0 conn(0x7fdda8145970 legacy=0x7fdda80b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda7fff640 1 -- 172.21.15.28:0/1732378909 >> v1:172.21.15.28:6789/0 conn(0x7fdda80b24d0 legacy=0x7fdda80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda7fff640 1 -- 172.21.15.28:0/1732378909 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda80cd2b0 con 0x7fdda80ceac0 2024-09-15T22:57:45.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda7fff640 1 --2- 172.21.15.28:0/1732378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda80ceac0 0x7fdda80d0360 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdda80d10a0 tx=0x7fdda001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cf8df26da5de7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda67fc640 1 -- 172.21.15.28:0/1732378909 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00b2070 con 0x7fdda80ceac0 2024-09-15T22:57:45.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda67fc640 1 -- 172.21.15.28:0/1732378909 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00a5740 con 0x7fdda80ceac0 2024-09-15T22:57:45.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fdda67fc640 1 -- 172.21.15.28:0/1732378909 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00a5b10 con 0x7fdda80ceac0 2024-09-15T22:57:45.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 -- 172.21.15.28:0/1732378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda80ceac0 msgr2=0x7fdda80d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 --2- 172.21.15.28:0/1732378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda80ceac0 0x7fdda80d0360 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdda80d10a0 tx=0x7fdda001c880 comp rx=0 tx=0).stop 2024-09-15T22:57:45.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 -- 172.21.15.28:0/1732378909 shutdown_connections 2024-09-15T22:57:45.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 --2- 172.21.15.28:0/1732378909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda80ceac0 0x7fdda80d0360 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 -- 172.21.15.28:0/1732378909 >> 172.21.15.28:0/1732378909 conn(0x7fdda806bcc0 msgr2=0x7fdda806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:45.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 -- 172.21.15.28:0/1732378909 shutdown_connections 2024-09-15T22:57:45.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.657+0000 7fddadd0d640 1 -- 172.21.15.28:0/1732378909 wait complete. 2024-09-15T22:57:45.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 Processor -- start 2024-09-15T22:57:45.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- start start 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda80b24d0 0x7fdda815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda80ceac0 0x7fdda814b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8169a00 con 0x7fdda8145970 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8169880 con 0x7fdda80ceac0 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdda8169b80 con 0x7fdda80b24d0 2024-09-15T22:57:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52424/0 (socket says 172.21.15.28:52424) 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 -- 172.21.15.28:0/2405934682 learned_addr learned my addr 172.21.15.28:0/2405934682 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda77fe640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda80b24d0 0x7fdda815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda6ffd640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda80ceac0 0x7fdda814b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 -- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda80b24d0 msgr2=0x7fdda815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda80b24d0 0x7fdda815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 -- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda80ceac0 msgr2=0x7fdda814b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda80ceac0 0x7fdda814b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 -- 172.21.15.28:0/2405934682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda81434d0 con 0x7fdda8145970 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdda7fff640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b0040 tx=0x7fdda0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00b2040 con 0x7fdda8145970 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00bf070 con 0x7fdda8145970 2024-09-15T22:57:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda81437b0 con 0x7fdda8145970 2024-09-15T22:57:45.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0009450 con 0x7fdda8145970 2024-09-15T22:57:45.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda8143d70 con 0x7fdda8145970 2024-09-15T22:57:45.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda80b1dc0 con 0x7fdda8145970 2024-09-15T22:57:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdda00ada30 con 0x7fdda8145970 2024-09-15T22:57:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.661+0000 7fdd8ffff640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 0x7fdd94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.665+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdda0120b10 con 0x7fdda8145970 2024-09-15T22:57:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.665+0000 7fdda77fe640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 0x7fdd94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.665+0000 7fdda77fe640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 0x7fdd94069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd98004e30 tx=0x7fdd98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:45.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.669+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdda0016500 con 0x7fdda8145970 2024-09-15T22:57:45.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:45.881+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7fdda813b390 con 0x7fdda8145970 2024-09-15T22:57:46.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.157+0000 7fdd8ffff640 1 -- 172.21.15.28:0/2405934682 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v95) ==== 147+0+0 (secure 0 0 0) 0x7fdda00f19e0 con 0x7fdda8145970 2024-09-15T22:57:46.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 msgr2=0x7fdd94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 0x7fdd94069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd98004e30 tx=0x7fdd98009040 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 msgr2=0x7fdda80b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdda00b0040 tx=0x7fdda0019620 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 shutdown_connections 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdda8145970 0x7fdda80b01c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fdd940678c0 0x7fdd94069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda80ceac0 0x7fdda814b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 --2- 172.21.15.28:0/2405934682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda80b24d0 0x7fdda815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 >> 172.21.15.28:0/2405934682 conn(0x7fdda806bcc0 msgr2=0x7fdda8141690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 shutdown_connections 2024-09-15T22:57:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.161+0000 7fddadd0d640 1 -- 172.21.15.28:0/2405934682 wait complete. 2024-09-15T22:57:46.191 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-09-15T22:57:46.192 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-09-15T22:57:46.193 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:46.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 Processor -- start 2024-09-15T22:57:46.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 -- start start 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa74c0cca90 0x7fa74c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74c0b55e0 con 0x7fa74c0b5200 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74c0cd020 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa751bd8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa74c0ce3b0 con 0x7fa74c0cca90 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa74c0cca90 0x7fa74c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa74c0cca90 0x7fa74c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52426/0 (socket says 172.21.15.28:52426) 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa74c0b5200 0x7fa74c0b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44004/0 (socket says 172.21.15.28:44004) 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 -- 172.21.15.28:0/210519479 learned_addr learned my addr 172.21.15.28:0/210519479 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 -- 172.21.15.28:0/210519479 >> v1:172.21.15.131:6789/0 conn(0x7fa74c0b1dc0 legacy=0x7fa74c0b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 -- 172.21.15.28:0/210519479 >> v1:172.21.15.28:6789/0 conn(0x7fa74c0b5200 legacy=0x7fa74c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.321+0000 7fa74affd640 1 -- 172.21.15.28:0/210519479 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0cd300 con 0x7fa74c0cca90 2024-09-15T22:57:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74affd640 1 --2- 172.21.15.28:0/210519479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0cca90 0x7fa74c15c0b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa74000bb10 tx=0x7fa74001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33df7f935ce413a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74a7fc640 1 -- 172.21.15.28:0/210519479 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7400b4070 con 0x7fa74c0cca90 2024-09-15T22:57:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74a7fc640 1 -- 172.21.15.28:0/210519479 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7400a7a30 con 0x7fa74c0cca90 2024-09-15T22:57:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74a7fc640 1 -- 172.21.15.28:0/210519479 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7400a7e00 con 0x7fa74c0cca90 2024-09-15T22:57:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- 172.21.15.28:0/210519479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0cca90 msgr2=0x7fa74c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 --2- 172.21.15.28:0/210519479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0cca90 0x7fa74c15c0b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa74000bb10 tx=0x7fa74001eb60 comp rx=0 tx=0).stop 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- 172.21.15.28:0/210519479 shutdown_connections 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 --2- 172.21.15.28:0/210519479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0cca90 0x7fa74c15c0b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- 172.21.15.28:0/210519479 >> 172.21.15.28:0/210519479 conn(0x7fa74c06bcc0 msgr2=0x7fa74c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- 172.21.15.28:0/210519479 shutdown_connections 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- 172.21.15.28:0/210519479 wait complete. 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 Processor -- start 2024-09-15T22:57:46.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- start start 2024-09-15T22:57:46.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b5200 0x7fa74c0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 0x7fa74c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0b4150 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0b3fd0 con 0x7fa74c0b5200 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa751bd8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c158360 con 0x7fa74c0cca90 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52432/0 (socket says 172.21.15.28:52432) 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 -- 172.21.15.28:0/385797639 learned_addr learned my addr 172.21.15.28:0/385797639 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74bfff640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 0x7fa74c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74affd640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b5200 0x7fa74c0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 -- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 msgr2=0x7fa74c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 0x7fa74c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 -- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b5200 msgr2=0x7fa74c0cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b5200 0x7fa74c0cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 -- 172.21.15.28:0/385797639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0af690 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74bfff640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 0x7fa74c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.325+0000 7fa74b7fe640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c420 tx=0x7fa73c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0074e0 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c007680 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c0af970 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c004a30 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c071fe0 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c15c0b0 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa73c01a020 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 0x7fa738069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa73c0858e0 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa74affd640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 0x7fa738069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.329+0000 7fa74affd640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 0x7fa738069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7400b1000 tx=0x7fa740008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.333+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa73c021070 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.497+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa74c0b19e0 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa733fff640 1 -- 172.21.15.28:0/385797639 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13044 (secure 0 0 0) 0x7fa73c056800 con 0x7fa74c0b1dc0 2024-09-15T22:57:46.503 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:46.503 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":38,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:45.146349+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6835/2539404134":"2024-09-16T22:57:41.125854+0000","172.21.15.28:6834/2539404134":"2024-09-16T22:57:41.125854+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:46.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 msgr2=0x7fa738069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 0x7fa738069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7400b1000 tx=0x7fa740008040 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 msgr2=0x7fa74c14d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c420 tx=0x7fa73c00c8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 shutdown_connections 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74c0cca90 0x7fa74c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa7380678f0 0x7fa738069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa74c0b5200 0x7fa74c0cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 --2- 172.21.15.28:0/385797639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74c0b1dc0 0x7fa74c14d700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 >> 172.21.15.28:0/385797639 conn(0x7fa74c06bcc0 msgr2=0x7fa74c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 shutdown_connections 2024-09-15T22:57:46.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.501+0000 7fa751bd8640 1 -- 172.21.15.28:0/385797639 wait complete. 2024-09-15T22:57:46.523 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:56:09.941276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:57:46.523 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:57:46.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 Processor -- start 2024-09-15T22:57:46.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 -- start start 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9074145b20 0x7f9074072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 0x7f90740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9074073a40 con 0x7f9074072860 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9074072ec0 con 0x7f9074145b20 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f907b561640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f90740731a0 con 0x7f90740b2540 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9074145b20 0x7f9074072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9074145b20 0x7f9074072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52446/0 (socket says 172.21.15.28:52446) 2024-09-15T22:57:46.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 -- 172.21.15.28:0/418008669 learned_addr learned my addr 172.21.15.28:0/418008669 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 -- 172.21.15.28:0/418008669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 msgr2=0x7f90740cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f9079afe640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 0x7f90740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 0x7f90740cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 -- 172.21.15.28:0/418008669 >> v1:172.21.15.131:6789/0 conn(0x7f9074072860 legacy=0x7f90740b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f90792fd640 1 -- 172.21.15.28:0/418008669 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9074073480 con 0x7f9074145b20 2024-09-15T22:57:46.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.645+0000 7f9079afe640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 0x7f90740cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:46.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f90792fd640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f9074072320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9070009870 tx=0x7f907001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e058dace5430de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f906bfff640 1 -- 172.21.15.28:0/418008669 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90700b2070 con 0x7f9074145b20 2024-09-15T22:57:46.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f906bfff640 1 -- 172.21.15.28:0/418008669 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90700a9070 con 0x7f9074145b20 2024-09-15T22:57:46.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f906bfff640 1 -- 172.21.15.28:0/418008669 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90700ad880 con 0x7f9074145b20 2024-09-15T22:57:46.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- 172.21.15.28:0/418008669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 msgr2=0x7f9074072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f9074072320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9070009870 tx=0x7f907001c490 comp rx=0 tx=0).stop 2024-09-15T22:57:46.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- 172.21.15.28:0/418008669 shutdown_connections 2024-09-15T22:57:46.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90740b2540 0x7f90740cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- 172.21.15.28:0/418008669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f9074072320 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- 172.21.15.28:0/418008669 >> 172.21.15.28:0/418008669 conn(0x7f907406bcc0 msgr2=0x7f907406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- 172.21.15.28:0/418008669 shutdown_connections 2024-09-15T22:57:46.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- 172.21.15.28:0/418008669 wait complete. 2024-09-15T22:57:46.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 Processor -- start 2024-09-15T22:57:46.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- start start 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9074072860 0x7f9074141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 0x7f9074159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90740d05f0 con 0x7f9074145b20 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f90740d0470 con 0x7f90740b2540 2024-09-15T22:57:46.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f907b561640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f90740d0770 con 0x7f9074072860 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f9079afe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f9079afe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52448/0 (socket says 172.21.15.28:52448) 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f9079afe640 1 -- 172.21.15.28:0/948301918 learned_addr learned my addr 172.21.15.28:0/948301918 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f90792fd640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9074072860 0x7f9074141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.649+0000 7f9078afc640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 0x7f9074159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 -- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9074072860 msgr2=0x7f9074141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9074072860 0x7f9074141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 -- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 msgr2=0x7f9074159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 0x7f9074159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 -- 172.21.15.28:0/948301918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9074144cb0 con 0x7f9074145b20 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9078afc640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 0x7f9074159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9079afe640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f906c00ced0 tx=0x7f906c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c003ba0 con 0x7f9074145b20 2024-09-15T22:57:46.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906c003d60 con 0x7f9074145b20 2024-09-15T22:57:46.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c00d880 con 0x7f9074145b20 2024-09-15T22:57:46.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90741427e0 con 0x7f9074145b20 2024-09-15T22:57:46.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90741444b0 con 0x7f9074145b20 2024-09-15T22:57:46.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074069220 con 0x7f9074145b20 2024-09-15T22:57:46.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f906c00da20 con 0x7f9074145b20 2024-09-15T22:57:46.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 0x7f9058069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f906c086b10 con 0x7f9074145b20 2024-09-15T22:57:46.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.653+0000 7f90792fd640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 0x7f9058069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.657+0000 7f90792fd640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 0x7f9058069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f90700af000 tx=0x7f9070008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.657+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f906c0573a0 con 0x7f9074145b20 2024-09-15T22:57:46.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.821+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90740cf720 con 0x7f9074145b20 2024-09-15T22:57:46.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.821+0000 7f9069ffb640 1 -- 172.21.15.28:0/948301918 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f906c05b6a0 con 0x7f9074145b20 2024-09-15T22:57:46.826 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 msgr2=0x7f9058069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 0x7f9058069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f90700af000 tx=0x7f9070008040 comp rx=0 tx=0).stop 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 msgr2=0x7f907415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f906c00ced0 tx=0x7f906c00a710 comp rx=0 tx=0).stop 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 shutdown_connections 2024-09-15T22:57:46.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9074145b20 0x7f907415c9d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f90580678c0 0x7f9058069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90740b2540 0x7f9074159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 --2- 172.21.15.28:0/948301918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9074072860 0x7f9074141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 >> 172.21.15.28:0/948301918 conn(0x7f907406bcc0 msgr2=0x7f90740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 shutdown_connections 2024-09-15T22:57:46.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.825+0000 7f907b561640 1 -- 172.21.15.28:0/948301918 wait complete. 2024-09-15T22:57:46.846 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-09-15T22:57:46.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 Processor -- start 2024-09-15T22:57:46.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 -- start start 2024-09-15T22:57:46.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f137c0b4710 0x7f137c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c0b4bd0 con 0x7f137c0ce210 2024-09-15T22:57:46.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f137c15f260 con 0x7f137c0b4710 2024-09-15T22:57:46.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1380bd9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0b4080 con 0x7f137c0cde30 2024-09-15T22:57:46.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f137a59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f137c0b4710 0x7f137c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f137c0b4710 0x7f137c0ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47318/0 (socket says 172.21.15.28:47318) 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 -- 172.21.15.28:0/826172630 learned_addr learned my addr 172.21.15.28:0/826172630 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 -- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 msgr2=0x7f137c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 -- 172.21.15.28:0/826172630 >> v1:172.21.15.131:6789/0 conn(0x7f137c0ce210 legacy=0x7f137c15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f1373fff640 1 -- 172.21.15.28:0/826172630 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c0b4eb0 con 0x7f137c0b4710 2024-09-15T22:57:46.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.969+0000 7f137a59c640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:46.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1373fff640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c0ccf20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13640098a0 tx=0x7f136401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7867b373df08285 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1379d9b640 1 -- 172.21.15.28:0/826172630 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640ab680 con 0x7f137c0b4710 2024-09-15T22:57:46.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1379d9b640 1 -- 172.21.15.28:0/826172630 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13640b0070 con 0x7f137c0b4710 2024-09-15T22:57:46.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1379d9b640 1 -- 172.21.15.28:0/826172630 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13640aba40 con 0x7f137c0b4710 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 msgr2=0x7f137c0ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c0ccf20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13640098a0 tx=0x7f136401c480 comp rx=0 tx=0).stop 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- 172.21.15.28:0/826172630 shutdown_connections 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c0ccf20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- 172.21.15.28:0/826172630 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- 172.21.15.28:0/826172630 >> 172.21.15.28:0/826172630 conn(0x7f137c06bcc0 msgr2=0x7f137c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- 172.21.15.28:0/826172630 shutdown_connections 2024-09-15T22:57:46.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- 172.21.15.28:0/826172630 wait complete. 2024-09-15T22:57:46.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 Processor -- start 2024-09-15T22:57:46.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- start start 2024-09-15T22:57:46.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.973+0000 7f1380bd9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f137c15eaf0 con 0x7f137c0ce210 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1380bd9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cf960 con 0x7f137c0b4710 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1380bd9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f137c15ec70 con 0x7f137c0cde30 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52454/0 (socket says 172.21.15.28:52454) 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 -- 172.21.15.28:0/3653714648 learned_addr learned my addr 172.21.15.28:0/3653714648 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137a59c640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1373fff640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 -- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 msgr2=0x7f137c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 -- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 msgr2=0x7f137c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:46.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:46.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 -- 172.21.15.28:0/3653714648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c14f930 con 0x7f137c0ce210 2024-09-15T22:57:46.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137ad9d640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f137400c760 tx=0x7f137400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374003b80 con 0x7f137c0ce210 2024-09-15T22:57:46.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1374003d20 con 0x7f137c0ce210 2024-09-15T22:57:46.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137400aa30 con 0x7f137c0ce210 2024-09-15T22:57:46.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c14fc10 con 0x7f137c0ce210 2024-09-15T22:57:46.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c14f570 con 0x7f137c0ce210 2024-09-15T22:57:46.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c0d0800 con 0x7f137c0ce210 2024-09-15T22:57:46.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f137400abd0 con 0x7f137c0ce210 2024-09-15T22:57:46.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 0x7f135c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:46.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f13740856c0 con 0x7f137c0ce210 2024-09-15T22:57:46.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.977+0000 7f137a59c640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 0x7f135c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:46.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.981+0000 7f137a59c640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 0x7f135c069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f137c0cc870 tx=0x7f136c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:46.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:46.985+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1374055eb0 con 0x7f137c0ce210 2024-09-15T22:57:47.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:47.209+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f137c0d0eb0 con 0x7f137c0ce210 2024-09-15T22:57:48.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.169+0000 7f1372ffd640 1 -- 172.21.15.28:0/3653714648 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v97) ==== 137+0+0 (secure 0 0 0) 0x7f137405a1b0 con 0x7f137c0ce210 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 msgr2=0x7f135c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 0x7f135c069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f137c0cc870 tx=0x7f136c009190 comp rx=0 tx=0).stop 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 msgr2=0x7f137c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f137400c760 tx=0x7f137400cc20 comp rx=0 tx=0).stop 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 shutdown_connections 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f137c0ce210 0x7f137c0ae8b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f137c0cde30 0x7f137c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f135c0678c0 0x7f135c069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 --2- 172.21.15.28:0/3653714648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f137c0b4710 0x7f137c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 >> 172.21.15.28:0/3653714648 conn(0x7f137c06bcc0 msgr2=0x7f137c15cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:48.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 shutdown_connections 2024-09-15T22:57:48.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.173+0000 7f1380bd9640 1 -- 172.21.15.28:0/3653714648 wait complete. 2024-09-15T22:57:48.199 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:57:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 Processor -- start 2024-09-15T22:57:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 -- start start 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd40b48e0 con 0x7fcfd4073310 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd40cfc40 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd88fe640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd40cf030 con 0x7fcfd40cea70 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52468/0 (socket says 172.21.15.28:52468) 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd259c640 1 -- 172.21.15.28:0/3894406243 learned_addr learned my addr 172.21.15.28:0/3894406243 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.329+0000 7fcfd1d9b640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd259c640 1 -- 172.21.15.28:0/3894406243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 msgr2=0x7fcfd40b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd259c640 1 -- 172.21.15.28:0/3894406243 >> v1:172.21.15.131:6789/0 conn(0x7fcfd4073310 legacy=0x7fcfd40737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd259c640 1 -- 172.21.15.28:0/3894406243 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd40cf310 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009870 tx=0x7fcfc401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f81b6eb9c6c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd159a640 1 -- 172.21.15.28:0/3894406243 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40b0070 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd159a640 1 -- 172.21.15.28:0/3894406243 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc40ab600 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd159a640 1 -- 172.21.15.28:0/3894406243 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40ab9d0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3894406243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 msgr2=0x7fcfd40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.333+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009870 tx=0x7fcfc401c4d0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3894406243 shutdown_connections 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3894406243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd40d0aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3894406243 >> 172.21.15.28:0/3894406243 conn(0x7fcfd4067a00 msgr2=0x7fcfd4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3894406243 shutdown_connections 2024-09-15T22:57:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3894406243 wait complete. 2024-09-15T22:57:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 Processor -- start 2024-09-15T22:57:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- start start 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 0x7fcfd415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40b55c0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40d2e20 con 0x7fcfd4073310 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd415fa60 con 0x7fcfd40cea70 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52484/0 (socket says 172.21.15.28:52484) 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 -- 172.21.15.28:0/3722765767 learned_addr learned my addr 172.21.15.28:0/3722765767 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 -- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 msgr2=0x7fcfd40b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 0x7fcfd415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd2d9d640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 -- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 msgr2=0x7fcfd415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 0x7fcfd415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 -- 172.21.15.28:0/3722765767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd406d6f0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 0x7fcfd415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd1d9b640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800d600 tx=0x7fcfc800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8004240 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc80043e0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd406d9d0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8003840 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd414f530 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.337+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd40d0aa0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.341+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfc80039e0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.341+0000 7fcfc2ffd640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 0x7fcfb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.341+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcfc8085cc0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.341+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 0x7fcfb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.341+0000 7fcfd259c640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 0x7fcfb4069db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40ad000 tx=0x7fcfc4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.345+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfc808c080 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.509+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcfd40b64d0 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.513+0000 7fcfc2ffd640 1 -- 172.21.15.28:0/3722765767 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fcfc8056a60 con 0x7fcfd40b3fc0 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 msgr2=0x7fcfb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 0x7fcfb4069db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40ad000 tx=0x7fcfc4008040 comp rx=0 tx=0).stop 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 msgr2=0x7fcfd414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800d600 tx=0x7fcfc800dac0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 shutdown_connections 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd40cea70 0x7fcfd40b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfd40b3fc0 0x7fcfd414e490 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fcfb40678f0 0x7fcfb4069db0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 --2- 172.21.15.28:0/3722765767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd4073310 0x7fcfd415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 >> 172.21.15.28:0/3722765767 conn(0x7fcfd4067a00 msgr2=0x7fcfd4067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:48.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 shutdown_connections 2024-09-15T22:57:48.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.517+0000 7fcfd88fe640 1 -- 172.21.15.28:0/3722765767 wait complete. 2024-09-15T22:57:48.537 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:57:48.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:57:48.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:57:48.686 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:57:48.686 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:48.686 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:48.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:57:48.693 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:57:48.693 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:48.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:57:48.699 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:57:48.699 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:48.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:57:48.743 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:57:48.743 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:57:48.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:57:48.749 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:57:48.749 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:48.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 Processor -- start 2024-09-15T22:57:48.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 -- start start 2024-09-15T22:57:48.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6b400b5200 0x7f6b4015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b400b55e0 con 0x7f6b400cca90 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400ce3b0 con 0x7f6b400b5200 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b47553640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4015c5f0 con 0x7f6b400b1dc0 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b45af0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b452ef640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6b400b5200 0x7f6b4015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b45af0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:35360/0 (socket says 172.21.15.28:35360) 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b45af0640 1 -- 172.21.15.28:0/1355396110 learned_addr learned my addr 172.21.15.28:0/1355396110 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b452ef640 1 -- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 msgr2=0x7f6b400b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:48.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b452ef640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b452ef640 1 -- 172.21.15.28:0/1355396110 >> v1:172.21.15.131:6789/0 conn(0x7f6b400cca90 legacy=0x7f6b400b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b452ef640 1 -- 172.21.15.28:0/1355396110 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b400cd020 con 0x7f6b400b5200 2024-09-15T22:57:48.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.917+0000 7f6b45af0640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:48.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b452ef640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400b5200 0x7f6b4015c0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097f0 tx=0x7f6b3c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b11aa26bd2e363a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b37fff640 1 -- 172.21.15.28:0/1355396110 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0b0070 con 0x7f6b400b5200 2024-09-15T22:57:48.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b37fff640 1 -- 172.21.15.28:0/1355396110 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0ab600 con 0x7f6b400b5200 2024-09-15T22:57:48.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b37fff640 1 -- 172.21.15.28:0/1355396110 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0ab9d0 con 0x7f6b400b5200 2024-09-15T22:57:48.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400b5200 msgr2=0x7f6b4015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400b5200 0x7f6b4015c0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097f0 tx=0x7f6b3c01c410 comp rx=0 tx=0).stop 2024-09-15T22:57:48.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- 172.21.15.28:0/1355396110 shutdown_connections 2024-09-15T22:57:48.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b400b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- 172.21.15.28:0/1355396110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400b5200 0x7f6b4015c0b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- 172.21.15.28:0/1355396110 >> 172.21.15.28:0/1355396110 conn(0x7f6b4006bcc0 msgr2=0x7f6b4006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:48.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- 172.21.15.28:0/1355396110 shutdown_connections 2024-09-15T22:57:48.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- 172.21.15.28:0/1355396110 wait complete. 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 Processor -- start 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- start start 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b40160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400cca90 0x7f6b40157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400b3ee0 con 0x7f6b400b5200 2024-09-15T22:57:48.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400b3d60 con 0x7f6b400cca90 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.921+0000 7f6b47553640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6b400b4060 con 0x7f6b400b1dc0 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52492/0 (socket says 172.21.15.28:52492) 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 -- 172.21.15.28:0/1332337700 learned_addr learned my addr 172.21.15.28:0/1332337700 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b45af0640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400cca90 0x7f6b40157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b452ef640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b40160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 -- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 msgr2=0x7f6b40160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b40160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 -- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400cca90 msgr2=0x7f6b40157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400cca90 0x7f6b40157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 -- 172.21.15.28:0/1332337700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b40158130 con 0x7f6b400b5200 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b44aee640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c3a0 tx=0x7f6b3000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b300052d0 con 0x7f6b400b5200 2024-09-15T22:57:48.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b30005470 con 0x7f6b400b5200 2024-09-15T22:57:48.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b400acc60 con 0x7f6b400b5200 2024-09-15T22:57:48.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007260 con 0x7f6b400b5200 2024-09-15T22:57:48.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b400ad220 con 0x7f6b400b5200 2024-09-15T22:57:48.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b400b21f0 con 0x7f6b400b5200 2024-09-15T22:57:48.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b30007400 con 0x7f6b400b5200 2024-09-15T22:57:48.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:48.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f6b30084cc0 con 0x7f6b400b5200 2024-09-15T22:57:48.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b452ef640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:48.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.925+0000 7f6b452ef640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 0x7f6b24069db0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ad000 tx=0x7f6b3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:48.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:48.929+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b30055540 con 0x7f6b400b5200 2024-09-15T22:57:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.129+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b400b1360 con 0x7f6b400b5200 2024-09-15T22:57:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.129+0000 7f6b35ffb640 1 -- 172.21.15.28:0/1332337700 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3917 (secure 0 0 0) 0x7f6b30059840 con 0x7f6b400b5200 2024-09-15T22:57:49.133 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:49.134 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":19,"btime":"2024-09-15T22:57:42:128914+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2913271210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":2913271210},{"type":"v1","addr":"172.21.15.28:6837","nonce":2913271210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/1117693744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1117693744},{"type":"v1","addr":"172.21.15.131:6834","nonce":1117693744}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1006966974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1006966974},{"type":"v1","addr":"172.21.15.131:6835","nonce":1006966974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1502589024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1502589024},{"type":"v1","addr":"172.21.15.28:6835","nonce":1502589024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-15T22:57:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 19 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 msgr2=0x7f6b24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 0x7f6b24069db0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0ad000 tx=0x7f6b3c008040 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 msgr2=0x7f6b401652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c3a0 tx=0x7f6b3000c860 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 shutdown_connections 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b400cca90 0x7f6b40157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b400b5200 0x7f6b401652f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 --2- 172.21.15.28:0/1332337700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b400b1dc0 0x7f6b40160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 >> 172.21.15.28:0/1332337700 conn(0x7f6b4006bcc0 msgr2=0x7f6b4015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 shutdown_connections 2024-09-15T22:57:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.133+0000 7f6b47553640 1 -- 172.21.15.28:0/1332337700 wait complete. 2024-09-15T22:57:49.153 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:57:49.153 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:57:49.153 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:57:49.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:49.153 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:57:49.154 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:57:49.154 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:57:49.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:49.154 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:57:49.154 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:57:49.154 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:57:49.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:49.154 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:57:49.155 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:57:49.155 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:57:49.155 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:57:49.165 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:57:49.165 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:57:49.166 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:57:49.166 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:57:49.171 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:57:49.171 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:57:49.174 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:57:49.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:57:49.207 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:57:49.207 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:49.208 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:57:49.208 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:49.218 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:57:49.218 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:49.219 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:57:49.220 DEBUG:teuthology.parallel:result is None 2024-09-15T22:57:49.220 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:57:49.265 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2024-09-15T22:57:49.269 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2024-09-15T22:57:49.289 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-09-15T22:57:49.293 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-09-15T22:57:49.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 Processor -- start 2024-09-15T22:57:49.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 -- start start 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9f6015c280 0x7f9f60073f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f6015c660 0x7f9f600b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6015cf90 con 0x7f9f6015cad0 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6015d940 con 0x7f9f6015c660 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f67db7640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6015d270 con 0x7f9f6015c280 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f6015c660 0x7f9f600b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f6015c660 0x7f9f600b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52528/0 (socket says 172.21.15.28:52528) 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 -- 172.21.15.28:0/2168619991 learned_addr learned my addr 172.21.15.28:0/2168619991 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:49.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65b53640 1 --2- 172.21.15.28:0/2168619991 >> v2:172.21.15.131:3300/0 conn(0x7f9f6015c280 0x7f9f60073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 -- 172.21.15.28:0/2168619991 >> v2:172.21.15.131:3300/0 conn(0x7f9f6015c280 msgr2=0x7f9f60073f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:49.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 --2- 172.21.15.28:0/2168619991 >> v2:172.21.15.131:3300/0 conn(0x7f9f6015c280 0x7f9f60073f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 -- 172.21.15.28:0/2168619991 >> v1:172.21.15.131:6789/0 conn(0x7f9f6015cad0 legacy=0x7f9f600b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.329+0000 7f9f65352640 1 -- 172.21.15.28:0/2168619991 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6015d550 con 0x7f9f6015c660 2024-09-15T22:57:49.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f65352640 1 --2- 172.21.15.28:0/2168619991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015c660 0x7f9f600b4380 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d35e0 tx=0x7f9f5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5fa86f04da2dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:49.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f64b51640 1 -- 172.21.15.28:0/2168619991 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f540b1070 con 0x7f9f6015c660 2024-09-15T22:57:49.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f64b51640 1 -- 172.21.15.28:0/2168619991 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f540ac600 con 0x7f9f6015c660 2024-09-15T22:57:49.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f64b51640 1 -- 172.21.15.28:0/2168619991 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f540ac9d0 con 0x7f9f6015c660 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 -- 172.21.15.28:0/2168619991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015c660 msgr2=0x7f9f600b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 --2- 172.21.15.28:0/2168619991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015c660 0x7f9f600b4380 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f600d35e0 tx=0x7f9f5401c490 comp rx=0 tx=0).stop 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 -- 172.21.15.28:0/2168619991 shutdown_connections 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 --2- 172.21.15.28:0/2168619991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015c660 0x7f9f600b4380 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 --2- 172.21.15.28:0/2168619991 >> v2:172.21.15.131:3300/0 conn(0x7f9f6015c280 0x7f9f60073f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 -- 172.21.15.28:0/2168619991 >> 172.21.15.28:0/2168619991 conn(0x7f9f60067a00 msgr2=0x7f9f60067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 -- 172.21.15.28:0/2168619991 shutdown_connections 2024-09-15T22:57:49.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.333+0000 7f9f67db7640 1 -- 172.21.15.28:0/2168619991 wait complete. 2024-09-15T22:57:49.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 Processor -- start 2024-09-15T22:57:49.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- start start 2024-09-15T22:57:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6015c280 0x7f9f601554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6015c660 0x7f9f6014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f60169150 con 0x7f9f6015cad0 2024-09-15T22:57:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9f60168fd0 con 0x7f9f6015c280 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9f601692d0 con 0x7f9f6015c660 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52536/0 (socket says 172.21.15.28:52536) 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 -- 172.21.15.28:0/992334665 learned_addr learned my addr 172.21.15.28:0/992334665 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f65352640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6015c660 0x7f9f6014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f65b53640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6015c280 0x7f9f601554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 -- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6015c660 msgr2=0x7f9f6014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6015c660 0x7f9f6014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 -- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6015c280 msgr2=0x7f9f601554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:49.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6015c280 0x7f9f601554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 -- 172.21.15.28:0/992334665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f601519c0 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f66354640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c730 tx=0x7f9f5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58003b80 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58003d20 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f60151ca0 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005310 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f60152260 con 0x7f9f6015cad0 2024-09-15T22:57:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f60152750 con 0x7f9f6015cad0 2024-09-15T22:57:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f580056c0 con 0x7f9f6015cad0 2024-09-15T22:57:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 0x7f9f44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f9f58085850 con 0x7f9f6015cad0 2024-09-15T22:57:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.337+0000 7f9f65b53640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 0x7f9f44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.341+0000 7f9f65b53640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 0x7f9f44069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009b60 tx=0x7f9f5c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:49.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.341+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f580560d0 con 0x7f9f6015cad0 2024-09-15T22:57:49.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:49.517+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9f60073f10 con 0x7f9f6015cad0 2024-09-15T22:57:50.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.185+0000 7f9f527fc640 1 -- 172.21.15.28:0/992334665 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) ==== 97+0+0 (secure 0 0 0) 0x7f9f5805a3d0 con 0x7f9f6015cad0 2024-09-15T22:57:50.190 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 msgr2=0x7f9f44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 0x7f9f44069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009b60 tx=0x7f9f5c009190 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 msgr2=0x7f9f6014e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c730 tx=0x7f9f5800cbf0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 shutdown_connections 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6015cad0 0x7f9f6014e970 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9f6015c660 0x7f9f6014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9f440678c0 0x7f9f44069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 --2- 172.21.15.28:0/992334665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f6015c280 0x7f9f601554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 >> 172.21.15.28:0/992334665 conn(0x7f9f60067a00 msgr2=0x7f9f60067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 shutdown_connections 2024-09-15T22:57:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.193+0000 7f9f67db7640 1 -- 172.21.15.28:0/992334665 wait complete. 2024-09-15T22:57:50.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:57:50.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 Processor -- start 2024-09-15T22:57:50.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 -- start start 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd68815c170 0x7fd688073c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 0x7fd6880b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd6880b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd6880b4d20 con 0x7fd68815c170 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd6880d1b20 con 0x7fd6880b4370 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd68dd96640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd6881600e0 con 0x7fd6880b5900 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd68815c170 0x7fd688073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd68815c170 0x7fd688073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52538/0 (socket says 172.21.15.28:52538) 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 -- 172.21.15.28:0/1930090472 learned_addr learned my addr 172.21.15.28:0/1930090472 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:50.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd67ffff640 1 --2- 172.21.15.28:0/1930090472 >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 0x7fd6880b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd687fff640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd6880b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 -- 172.21.15.28:0/1930090472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 msgr2=0x7fd6880b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd6880b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 -- 172.21.15.28:0/1930090472 >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 msgr2=0x7fd6880b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1930090472 >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 0x7fd6880b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd6877fe640 1 -- 172.21.15.28:0/1930090472 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6881603c0 con 0x7fd68815c170 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd67ffff640 1 --2- 172.21.15.28:0/1930090472 >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 0x7fd6880b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:50.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.389+0000 7fd687fff640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd6880b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:50.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd68815c170 0x7fd688073c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd6880b6fe0 tx=0x7fd67801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6eedd13bc4baf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd686ffd640 1 -- 172.21.15.28:0/1930090472 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b0070 con 0x7fd68815c170 2024-09-15T22:57:50.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd686ffd640 1 -- 172.21.15.28:0/1930090472 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6780ab600 con 0x7fd68815c170 2024-09-15T22:57:50.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd686ffd640 1 -- 172.21.15.28:0/1930090472 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780ab9d0 con 0x7fd68815c170 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 -- 172.21.15.28:0/1930090472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd68815c170 msgr2=0x7fd688073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd68815c170 0x7fd688073c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd6880b6fe0 tx=0x7fd67801c230 comp rx=0 tx=0).stop 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 -- 172.21.15.28:0/1930090472 shutdown_connections 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd6880b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1930090472 >> v2:172.21.15.131:3300/0 conn(0x7fd6880b4370 0x7fd6880b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1930090472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd68815c170 0x7fd688073c90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 -- 172.21.15.28:0/1930090472 >> 172.21.15.28:0/1930090472 conn(0x7fd688067bd0 msgr2=0x7fd688067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 -- 172.21.15.28:0/1930090472 shutdown_connections 2024-09-15T22:57:50.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.393+0000 7fd68dd96640 1 -- 172.21.15.28:0/1930090472 wait complete. 2024-09-15T22:57:50.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 Processor -- start 2024-09-15T22:57:50.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- start start 2024-09-15T22:57:50.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd688153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd68815c170 0x7fd68806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd68815c550 con 0x7fd6880b4370 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd6880b6680 con 0x7fd68815c170 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd68815fd70 con 0x7fd6880b5900 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52554/0 (socket says 172.21.15.28:52554) 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 -- 172.21.15.28:0/1411874462 learned_addr learned my addr 172.21.15.28:0/1411874462 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 -- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 msgr2=0x7fd688153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd688153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 -- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd68815c170 msgr2=0x7fd68806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd68815c170 0x7fd68806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 -- 172.21.15.28:0/1411874462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68806cdd0 con 0x7fd6880b4370 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd6877fe640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd67801a8e0 tx=0x7fd678018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b9070 con 0x7fd6880b4370 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6780b4600 con 0x7fd6880b4370 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6881fb390 con 0x7fd6880b4370 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b0040 con 0x7fd6880b4370 2024-09-15T22:57:50.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6881fb950 con 0x7fd6880b4370 2024-09-15T22:57:50.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.397+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6880cfec0 con 0x7fd6880b4370 2024-09-15T22:57:50.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.401+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6780bc070 con 0x7fd6880b4370 2024-09-15T22:57:50.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.401+0000 7fd684ff9640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 0x7fd668069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.401+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fd67811eb50 con 0x7fd6880b4370 2024-09-15T22:57:50.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.401+0000 7fd67ffff640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 0x7fd668069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.401+0000 7fd67ffff640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 0x7fd668069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd6881faaa0 tx=0x7fd670008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.405+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd678016110 con 0x7fd6880b4370 2024-09-15T22:57:50.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.633+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd6880b3df0 con 0x7fd6880b4370 2024-09-15T22:57:50.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.633+0000 7fd684ff9640 1 -- 172.21.15.28:0/1411874462 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5298 (secure 0 0 0) 0x7fd6780efa70 con 0x7fd6880b4370 2024-09-15T22:57:50.636 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm3VmBABAAvArGEMRHBqR4+onQhfvLWw==", 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.637 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmNvriDBAAOw+cBCCkpdgYizzytoLBqw==", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm+UhHCRAADCzYYFA/byDLhc0gyhKtjg==", 2024-09-15T22:57:50.638 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.d", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedm/YYtFRAACfJwJbZMto9fuV3Cwwy17g==", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:50.639 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDWZedm0mjGLBAAgudL/qgd3Apx7aNMkuv1ew==", 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2024-09-15T22:57:50.640 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDZZedmJC4YOxAAYFJqOAKxORBJu/etCT0cug==", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDdZedm0NGqHxAAuo+sT8jTpNMk0Nn6e0asOw==", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.641 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDhZedmjcjJExAApX0Gy+AFj4agMJeTYEjlqw==", 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.642 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDnZedmOydVKhAAefigK6MQckJuqoT6uvgzng==", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDqZedmum88ORAAmvNaB0qjP0GC7HsW6SSYlw==", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.643 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDuZedm8moZDhAANQOtbsX8obocRfT7T/7c8g==", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDxZedmYMjiGhAA+N2wn1W2iROVzEVPtN9EHw==", 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ==", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r", 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.645 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.1", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmEgz6IhAABJCMdbBOU5/r3vd3wgkbiw==", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.2", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmMXYkIBAA2gP9aTm1jv+VT40Ph7wqTw==", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.3", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDVZedmRKojKBAAY3fDsqBeGseUKhWG5OymrA==", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.647 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedmjkJ8JRAAa/NR6wFNQWNqCNKhKI9fdQ==", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedmLRUPORAAaKVTRYkUjwpfJIdrQ3iXPw==", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2024-09-15T22:57:50.648 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDUZedm/h5PNhAAHa2ueT90xSXDFYPKgX/z1A==", 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-09-15T22:57:50.649 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:50.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 msgr2=0x7fd668069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 0x7fd668069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd6881faaa0 tx=0x7fd670008040 comp rx=0 tx=0).stop 2024-09-15T22:57:50.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 msgr2=0x7fd6881fab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd67801a8e0 tx=0x7fd678018fd0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 shutdown_connections 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd6680678c0 0x7fd668069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd68815c170 0x7fd68806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6880b5900 0x7fd688153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 --2- 172.21.15.28:0/1411874462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6880b4370 0x7fd6881fab40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 >> 172.21.15.28:0/1411874462 conn(0x7fd688067bd0 msgr2=0x7fd68815f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 shutdown_connections 2024-09-15T22:57:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.637+0000 7fd68dd96640 1 -- 172.21.15.28:0/1411874462 wait complete. 2024-09-15T22:57:50.656 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:57:50.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 Processor -- start 2024-09-15T22:57:50.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 -- start start 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f635406d870 0x7f635406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f635415e820 0x7f63540cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635406e190 con 0x7f63540b3610 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f63540d2ba0 con 0x7f635406d870 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f635ad42640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f63540d2e80 con 0x7f635415e820 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f635406d870 0x7f635406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f635406d870 0x7f635406dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52566/0 (socket says 172.21.15.28:52566) 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 -- 172.21.15.28:0/1411422514 learned_addr learned my addr 172.21.15.28:0/1411422514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 -- 172.21.15.28:0/1411422514 >> v2:172.21.15.131:3300/0 conn(0x7f635415e820 msgr2=0x7f63540cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:50.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 --2- 172.21.15.28:0/1411422514 >> v2:172.21.15.131:3300/0 conn(0x7f635415e820 0x7f63540cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 -- 172.21.15.28:0/1411422514 >> v1:172.21.15.131:6789/0 conn(0x7f63540b3610 legacy=0x7f63540d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:50.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.761+0000 7f6358ade640 1 -- 172.21.15.28:0/1411422514 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63540d3160 con 0x7f635406d870 2024-09-15T22:57:50.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f6358ade640 1 --2- 172.21.15.28:0/1411422514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f635406dc50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f635408d8d0 tx=0x7f634401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0fe404d247df87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f63537fe640 1 -- 172.21.15.28:0/1411422514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440a5870 con 0x7f635406d870 2024-09-15T22:57:50.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f63537fe640 1 -- 172.21.15.28:0/1411422514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63440a5a10 con 0x7f635406d870 2024-09-15T22:57:50.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f63537fe640 1 -- 172.21.15.28:0/1411422514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440a5de0 con 0x7f635406d870 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- 172.21.15.28:0/1411422514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 msgr2=0x7f635406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 --2- 172.21.15.28:0/1411422514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f635406dc50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f635408d8d0 tx=0x7f634401c9b0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- 172.21.15.28:0/1411422514 shutdown_connections 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 --2- 172.21.15.28:0/1411422514 >> v2:172.21.15.131:3300/0 conn(0x7f635415e820 0x7f63540cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 --2- 172.21.15.28:0/1411422514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f635406dc50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- 172.21.15.28:0/1411422514 >> 172.21.15.28:0/1411422514 conn(0x7f63540d4910 msgr2=0x7f63540d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:50.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- 172.21.15.28:0/1411422514 shutdown_connections 2024-09-15T22:57:50.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- 172.21.15.28:0/1411422514 wait complete. 2024-09-15T22:57:50.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 Processor -- start 2024-09-15T22:57:50.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.765+0000 7f635ad42640 1 -- start start 2024-09-15T22:57:50.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63540b3610 0x7f63540cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f635415e820 0x7f6354145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f635416b1a0 con 0x7f635406d870 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f63540d4350 con 0x7f63540b3610 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f635416b320 con 0x7f635415e820 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52578/0 (socket says 172.21.15.28:52578) 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 -- 172.21.15.28:0/2528614398 learned_addr learned my addr 172.21.15.28:0/2528614398 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 -- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f635415e820 msgr2=0x7f6354145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f635415e820 0x7f6354145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 -- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63540b3610 msgr2=0x7f63540cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63540b3610 0x7f63540cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 -- 172.21.15.28:0/2528614398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63540ceb30 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6358ade640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f63440af040 tx=0x7f6344019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440bc020 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63440b88a0 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440b8c90 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635415a710 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63540ce570 con 0x7f635406d870 2024-09-15T22:57:50.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635415a8e0 con 0x7f635406d870 2024-09-15T22:57:50.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63440bf020 con 0x7f635406d870 2024-09-15T22:57:50.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 0x7f6334069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:50.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f63441203f0 con 0x7f635406d870 2024-09-15T22:57:50.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6353fff640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 0x7f6334069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:50.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.769+0000 7f6353fff640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 0x7f6334069db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63540b5340 tx=0x7f633c006c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:50.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.773+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63440c7020 con 0x7f635406d870 2024-09-15T22:57:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.937+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f635406dc50 con 0x7f635406d870 2024-09-15T22:57:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.937+0000 7f63517fa640 1 -- 172.21.15.28:0/2528614398 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f63440165a0 con 0x7f635406d870 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:57:50.941 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-09-15T22:57:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 msgr2=0x7f6334069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 0x7f6334069db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63540b5340 tx=0x7f633c006c00 comp rx=0 tx=0).stop 2024-09-15T22:57:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 msgr2=0x7f63540caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f63440af040 tx=0x7f6344019750 comp rx=0 tx=0).stop 2024-09-15T22:57:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 shutdown_connections 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f635415e820 0x7f6354145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f63340678f0 0x7f6334069db0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63540b3610 0x7f63540cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 --2- 172.21.15.28:0/2528614398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f635406d870 0x7f63540caf30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 >> 172.21.15.28:0/2528614398 conn(0x7f63540d4910 msgr2=0x7f63540b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 shutdown_connections 2024-09-15T22:57:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:50.941+0000 7f635ad42640 1 -- 172.21.15.28:0/2528614398 wait complete. 2024-09-15T22:57:50.959 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:57:50.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:57:51.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 Processor -- start 2024-09-15T22:57:51.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 -- start start 2024-09-15T22:57:51.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d7415b8d0 0x7f1d740d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d7415c0c0 con 0x7f1d740d0560 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1d740ce1a0 con 0x7f1d7415b8d0 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d7b001640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7415c3a0 con 0x7f1d74155a40 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d78d9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d73fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d7415b8d0 0x7f1d740d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d78d9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:35438/0 (socket says 172.21.15.28:35438) 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.089+0000 7f1d78d9d640 1 -- 172.21.15.28:0/2494938414 learned_addr learned my addr 172.21.15.28:0/2494938414 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:51.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d78d9d640 1 -- 172.21.15.28:0/2494938414 >> v2:172.21.15.131:3300/0 conn(0x7f1d7415b8d0 msgr2=0x7f1d740d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:51.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2494938414 >> v2:172.21.15.131:3300/0 conn(0x7f1d7415b8d0 0x7f1d740d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:51.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d78d9d640 1 -- 172.21.15.28:0/2494938414 >> v1:172.21.15.131:6789/0 conn(0x7f1d740d0560 legacy=0x7f1d7406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:51.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d78d9d640 1 -- 172.21.15.28:0/2494938414 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7415c680 con 0x7f1d74155a40 2024-09-15T22:57:51.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2494938414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009870 tx=0x7f1d6801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d357b042f8667f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:51.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d737fe640 1 -- 172.21.15.28:0/2494938414 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680b2070 con 0x7f1d74155a40 2024-09-15T22:57:51.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d737fe640 1 -- 172.21.15.28:0/2494938414 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680a9070 con 0x7f1d74155a40 2024-09-15T22:57:51.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.093+0000 7f1d737fe640 1 -- 172.21.15.28:0/2494938414 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680ad880 con 0x7f1d74155a40 2024-09-15T22:57:51.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2494938414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 msgr2=0x7f1d740b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:51.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2494938414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009870 tx=0x7f1d6801c560 comp rx=0 tx=0).stop 2024-09-15T22:57:51.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2494938414 shutdown_connections 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2494938414 >> v2:172.21.15.131:3300/0 conn(0x7f1d7415b8d0 0x7f1d740d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2494938414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d74155a40 0x7f1d740b3480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2494938414 >> 172.21.15.28:0/2494938414 conn(0x7f1d7406bcc0 msgr2=0x7f1d7406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2494938414 shutdown_connections 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2494938414 wait complete. 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 Processor -- start 2024-09-15T22:57:51.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- start start 2024-09-15T22:57:51.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 0x7f1d74156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 0x7f1d74148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74168120 con 0x7f1d74155a40 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1d740d0970 con 0x7f1d740d0560 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1d741682a0 con 0x7f1d7415b8d0 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52590/0 (socket says 172.21.15.28:52590) 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 -- 172.21.15.28:0/2199613506 learned_addr learned my addr 172.21.15.28:0/2199613506 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 0x7f1d74156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7959e640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 0x7f1d74148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 -- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 msgr2=0x7f1d74148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 0x7f1d74148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 -- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 msgr2=0x7f1d74156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:51.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 0x7f1d74156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 -- 172.21.15.28:0/2199613506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d74153a30 con 0x7f1d74155a40 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7959e640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 0x7f1d74148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 0x7f1d74156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d73fff640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e870 tx=0x7f1d6000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60017070 con 0x7f1d74155a40 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6000c940 con 0x7f1d74155a40 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d741560c0 con 0x7f1d74155a40 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000cd10 con 0x7f1d74155a40 2024-09-15T22:57:51.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.097+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d74156680 con 0x7f1d74155a40 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d74069220 con 0x7f1d74155a40 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d6001a070 con 0x7f1d74155a40 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d717fa640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 0x7f1d58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f1d60085b90 con 0x7f1d74155a40 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 0x7f1d58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:51.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.101+0000 7f1d78d9d640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 0x7f1d58069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:51.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.105+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d60056a20 con 0x7f1d74155a40 2024-09-15T22:57:51.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:51.273+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d740b3480 con 0x7f1d74155a40 2024-09-15T22:57:52.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.193+0000 7f1d717fa640 1 -- 172.21.15.28:0/2199613506 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f1d60056320 con 0x7f1d74155a40 2024-09-15T22:57:52.197 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-09-15T22:57:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 msgr2=0x7f1d58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 0x7f1d58069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1d680af000 tx=0x7f1d680a7000 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 msgr2=0x7f1d740b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e870 tx=0x7f1d6000ec70 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 shutdown_connections 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7415b8d0 0x7f1d74148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d74155a40 0x7f1d740b0f90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f1d580678c0 0x7f1d58069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 --2- 172.21.15.28:0/2199613506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d740d0560 0x7f1d74156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 >> 172.21.15.28:0/2199613506 conn(0x7f1d7406bcc0 msgr2=0x7f1d740b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 shutdown_connections 2024-09-15T22:57:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.197+0000 7f1d7b001640 1 -- 172.21.15.28:0/2199613506 wait complete. 2024-09-15T22:57:52.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:57:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.353+0000 7f8804419640 1 Processor -- start 2024-09-15T22:57:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 -- start start 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f87fc145bb0 0x7f87fc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f87fc0b1e30 0x7f87fc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87fc073b40 con 0x7f87fc0b31a0 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0b27e0 con 0x7f87fc0b1e30 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f8804419640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0b3d40 con 0x7f87fc145bb0 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f87fc0b1e30 0x7f87fc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f87fc0b1e30 0x7f87fc0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52594/0 (socket says 172.21.15.28:52594) 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 -- 172.21.15.28:0/2467089650 learned_addr learned my addr 172.21.15.28:0/2467089650 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88021b5640 1 --2- 172.21.15.28:0/2467089650 >> v2:172.21.15.131:3300/0 conn(0x7f87fc145bb0 0x7f87fc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 -- 172.21.15.28:0/2467089650 >> v2:172.21.15.131:3300/0 conn(0x7f87fc145bb0 msgr2=0x7f87fc15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:52.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 --2- 172.21.15.28:0/2467089650 >> v2:172.21.15.131:3300/0 conn(0x7f87fc145bb0 0x7f87fc15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 -- 172.21.15.28:0/2467089650 >> v1:172.21.15.131:6789/0 conn(0x7f87fc0b31a0 legacy=0x7f87fc0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:52.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.357+0000 7f88029b6640 1 -- 172.21.15.28:0/2467089650 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc073e20 con 0x7f87fc0b1e30 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- 172.21.15.28:0/2467089650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc0b1e30 0x7f87fc0b22a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0b3ec0 tx=0x7f87f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e396b3d36798af93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88011b3640 1 -- 172.21.15.28:0/2467089650 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f40a55e0 con 0x7f87fc0b1e30 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88011b3640 1 -- 172.21.15.28:0/2467089650 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f40a5780 con 0x7f87fc0b1e30 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88011b3640 1 -- 172.21.15.28:0/2467089650 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f40a5b50 con 0x7f87fc0b1e30 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/2467089650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc0b1e30 msgr2=0x7f87fc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- 172.21.15.28:0/2467089650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc0b1e30 0x7f87fc0b22a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0b3ec0 tx=0x7f87f401c920 comp rx=0 tx=0).stop 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/2467089650 shutdown_connections 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- 172.21.15.28:0/2467089650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc0b1e30 0x7f87fc0b22a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- 172.21.15.28:0/2467089650 >> v2:172.21.15.131:3300/0 conn(0x7f87fc145bb0 0x7f87fc15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/2467089650 >> 172.21.15.28:0/2467089650 conn(0x7f87fc067e30 msgr2=0x7f87fc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:52.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/2467089650 shutdown_connections 2024-09-15T22:57:52.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/2467089650 wait complete. 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 Processor -- start 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- start start 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87fc0b1e30 0x7f87fc143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87fc0b31a0 0x7f87fc1377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0b4d50 con 0x7f87fc145bb0 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0b4bd0 con 0x7f87fc0b1e30 2024-09-15T22:57:52.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc071e90 con 0x7f87fc0b31a0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52604/0 (socket says 172.21.15.28:52604) 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 -- 172.21.15.28:0/1776912120 learned_addr learned my addr 172.21.15.28:0/1776912120 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88021b5640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87fc0b1e30 0x7f87fc143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88019b4640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87fc0b31a0 0x7f87fc1377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 -- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87fc0b31a0 msgr2=0x7f87fc1377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87fc0b31a0 0x7f87fc1377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 -- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87fc0b1e30 msgr2=0x7f87fc143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87fc0b1e30 0x7f87fc143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 -- 172.21.15.28:0/1776912120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc15abd0 con 0x7f87fc145bb0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f88029b6640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f87f40af040 tx=0x7f87f40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f40bc020 con 0x7f87fc145bb0 2024-09-15T22:57:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f40b8670 con 0x7f87fc145bb0 2024-09-15T22:57:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc142e70 con 0x7f87fc145bb0 2024-09-15T22:57:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.361+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4009510 con 0x7f87fc145bb0 2024-09-15T22:57:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc143430 con 0x7f87fc145bb0 2024-09-15T22:57:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc142c90 con 0x7f87fc145bb0 2024-09-15T22:57:52.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87f40bf020 con 0x7f87fc145bb0 2024-09-15T22:57:52.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f87f2ffd640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 0x7f87e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:52.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f88021b5640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 0x7f87e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:52.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f87f4120920 con 0x7f87fc145bb0 2024-09-15T22:57:52.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.365+0000 7f88021b5640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 0x7f87e0069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87f80096f0 tx=0x7f87f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:52.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.369+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87fc142c90 con 0x7f87fc145bb0 2024-09-15T22:57:52.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:52.533+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f87fc141590 con 0x7f87fc145bb0 2024-09-15T22:57:53.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.197+0000 7f87f2ffd640 1 -- 172.21.15.28:0/1776912120 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f87f40c6030 con 0x7f87fc145bb0 2024-09-15T22:57:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-09-15T22:57:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 msgr2=0x7f87e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 0x7f87e0069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87f80096f0 tx=0x7f87f8008040 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 msgr2=0x7f87fc13c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f87f40af040 tx=0x7f87f40196c0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 shutdown_connections 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87fc145bb0 0x7f87fc13c900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87fc0b31a0 0x7f87fc1377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f87e00678c0 0x7f87e0069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 --2- 172.21.15.28:0/1776912120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87fc0b1e30 0x7f87fc143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 >> 172.21.15.28:0/1776912120 conn(0x7f87fc067e30 msgr2=0x7f87fc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 shutdown_connections 2024-09-15T22:57:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.201+0000 7f8804419640 1 -- 172.21.15.28:0/1776912120 wait complete. 2024-09-15T22:57:53.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:57:53.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 Processor -- start 2024-09-15T22:57:53.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 -- start start 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f570c15e410 0x7f570c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f570c15e7f0 0x7f570c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570c0b65f0 con 0x7f570c0b5380 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f570c15ece0 con 0x7f570c15e410 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f57121dd640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f570c15efc0 con 0x7f570c15e7f0 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f570c15e410 0x7f570c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f570c15e410 0x7f570c0cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55764/0 (socket says 172.21.15.28:55764) 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 -- 172.21.15.28:0/2510871804 learned_addr learned my addr 172.21.15.28:0/2510871804 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570bfff640 1 --1- 172.21.15.28:0/2510871804 >> v1:172.21.15.28:6789/0 conn(0x7f570c0b5380 0x7f570c161f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59300/0 (socket says 172.21.15.28:59300) 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570affd640 1 --2- 172.21.15.28:0/2510871804 >> v2:172.21.15.131:3300/0 conn(0x7f570c15e7f0 0x7f570c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 -- 172.21.15.28:0/2510871804 >> v2:172.21.15.131:3300/0 conn(0x7f570c15e7f0 msgr2=0x7f570c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2510871804 >> v2:172.21.15.131:3300/0 conn(0x7f570c15e7f0 0x7f570c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 -- 172.21.15.28:0/2510871804 >> v1:172.21.15.28:6789/0 conn(0x7f570c0b5380 legacy=0x7f570c161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570b7fe640 1 -- 172.21.15.28:0/2510871804 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c15f2a0 con 0x7f570c15e410 2024-09-15T22:57:53.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.364+0000 7f570a7fc640 1 -- 172.21.15.28:0/2510871804 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537541561 0 0) 0x7f570c0b65f0 con 0x7f570c0b5380 2024-09-15T22:57:53.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2510871804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c0cf7e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f570c0b6b30 tx=0x7f570401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40ddddfa48f4d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:53.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f570a7fc640 1 -- 172.21.15.28:0/2510871804 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57040b4070 con 0x7f570c15e410 2024-09-15T22:57:53.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f570a7fc640 1 -- 172.21.15.28:0/2510871804 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57040af400 con 0x7f570c15e410 2024-09-15T22:57:53.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f570a7fc640 1 -- 172.21.15.28:0/2510871804 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57040af7d0 con 0x7f570c15e410 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- 172.21.15.28:0/2510871804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 msgr2=0x7f570c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 --2- 172.21.15.28:0/2510871804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c0cf7e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f570c0b6b30 tx=0x7f570401f1e0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- 172.21.15.28:0/2510871804 shutdown_connections 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 --2- 172.21.15.28:0/2510871804 >> v2:172.21.15.131:3300/0 conn(0x7f570c15e7f0 0x7f570c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 --2- 172.21.15.28:0/2510871804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c0cf7e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- 172.21.15.28:0/2510871804 >> 172.21.15.28:0/2510871804 conn(0x7f570c0716d0 msgr2=0x7f570c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- 172.21.15.28:0/2510871804 shutdown_connections 2024-09-15T22:57:53.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- 172.21.15.28:0/2510871804 wait complete. 2024-09-15T22:57:53.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 Processor -- start 2024-09-15T22:57:53.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.368+0000 7f57121dd640 1 -- start start 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 0x7f570c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 0x7f570c1f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f570c160950 con 0x7f570c15e410 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1607d0 con 0x7f570c15e7f0 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f570c160ad0 con 0x7f570c0b5380 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55780/0 (socket says 172.21.15.28:55780) 2024-09-15T22:57:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 -- 172.21.15.28:0/2448530313 learned_addr learned my addr 172.21.15.28:0/2448530313 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570bfff640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 0x7f570c1f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 0x7f570c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 -- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 msgr2=0x7f570c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 0x7f570c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 -- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 msgr2=0x7f570c1f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 0x7f570c1f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 -- 172.21.15.28:0/2448530313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c0adc30 con 0x7f570c15e410 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570bfff640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 0x7f570c1f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 0x7f570c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570affd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f570000d5f0 tx=0x7f570000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000125f0 con 0x7f570c15e410 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5700019070 con 0x7f570c15e410 2024-09-15T22:57:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c0abae0 con 0x7f570c15e410 2024-09-15T22:57:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000129b0 con 0x7f570c15e410 2024-09-15T22:57:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c0ae190 con 0x7f570c15e410 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570c0cf7e0 con 0x7f570c15e410 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5700012b50 con 0x7f570c15e410 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7f5700085fe0 con 0x7f570c15e410 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.372+0000 7f570b7fe640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 0x7f56f8069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57040b1000 tx=0x7f57040aa000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.380+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f570c0adc30 con 0x7f570c15e410 2024-09-15T22:57:53.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:53.580+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f570c1624c0 con 0x7f570c15e410 2024-09-15T22:57:54.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.240+0000 7f56f3fff640 1 -- 172.21.15.28:0/2448530313 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7f5700056c10 con 0x7f570c15e410 2024-09-15T22:57:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 7 and data pool 8 2024-09-15T22:57:54.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 msgr2=0x7f56f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 0x7f56f8069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57040b1000 tx=0x7f57040aa000 comp rx=0 tx=0).stop 2024-09-15T22:57:54.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 msgr2=0x7f570c1f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f570000d5f0 tx=0x7f570000dab0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 shutdown_connections 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c15e7f0 0x7f570c1f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f570c15e410 0x7f570c1f7610 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 --2- 172.21.15.28:0/2448530313 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f570c0b5380 0x7f570c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 >> 172.21.15.28:0/2448530313 conn(0x7f570c0716d0 msgr2=0x7f570c0cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 shutdown_connections 2024-09-15T22:57:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.252+0000 7f57121dd640 1 -- 172.21.15.28:0/2448530313 wait complete. 2024-09-15T22:57:54.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:54.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.408+0000 7f9310181640 1 Processor -- start 2024-09-15T22:57:54.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.408+0000 7f9310181640 1 -- start start 2024-09-15T22:57:54.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f9310181640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93080b24d0 0x7f93080cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f9310181640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f93080d0190 0x7f93080cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f9310181640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080d0960 con 0x7f9308145970 2024-09-15T22:57:54.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f9310181640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f93080d0f20 con 0x7f93080d0190 2024-09-15T22:57:54.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f9310181640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f93080cd620 con 0x7f93080b24d0 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f93080d0190 0x7f93080cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f93080d0190 0x7f93080cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55784/0 (socket says 172.21.15.28:55784) 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 -- 172.21.15.28:0/3363037520 learned_addr learned my addr 172.21.15.28:0/3363037520 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930d71c640 1 --2- 172.21.15.28:0/3363037520 >> v2:172.21.15.131:3300/0 conn(0x7f93080b24d0 0x7f93080cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 -- 172.21.15.28:0/3363037520 >> v2:172.21.15.131:3300/0 conn(0x7f93080b24d0 msgr2=0x7f93080cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 --2- 172.21.15.28:0/3363037520 >> v2:172.21.15.131:3300/0 conn(0x7f93080b24d0 0x7f93080cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 -- 172.21.15.28:0/3363037520 >> v1:172.21.15.131:6789/0 conn(0x7f9308145970 legacy=0x7f93080b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.412+0000 7f930e71e640 1 -- 172.21.15.28:0/3363037520 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080d0c40 con 0x7f93080d0190 2024-09-15T22:57:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930e71e640 1 --2- 172.21.15.28:0/3363037520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93080d0190 0x7f93080cdab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f93080afd50 tx=0x7f930001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52708f8eee01077f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930cf1b640 1 -- 172.21.15.28:0/3363037520 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000a5780 con 0x7f93080d0190 2024-09-15T22:57:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930cf1b640 1 -- 172.21.15.28:0/3363037520 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000a5920 con 0x7f93080d0190 2024-09-15T22:57:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930cf1b640 1 -- 172.21.15.28:0/3363037520 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000a5cf0 con 0x7f93080d0190 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- 172.21.15.28:0/3363037520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93080d0190 msgr2=0x7f93080cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- 172.21.15.28:0/3363037520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93080d0190 0x7f93080cdab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f93080afd50 tx=0x7f930001c930 comp rx=0 tx=0).stop 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- 172.21.15.28:0/3363037520 shutdown_connections 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- 172.21.15.28:0/3363037520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f93080d0190 0x7f93080cdab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- 172.21.15.28:0/3363037520 >> v2:172.21.15.131:3300/0 conn(0x7f93080b24d0 0x7f93080cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- 172.21.15.28:0/3363037520 >> 172.21.15.28:0/3363037520 conn(0x7f930806bcc0 msgr2=0x7f930806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- 172.21.15.28:0/3363037520 shutdown_connections 2024-09-15T22:57:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- 172.21.15.28:0/3363037520 wait complete. 2024-09-15T22:57:54.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 Processor -- start 2024-09-15T22:57:54.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- start start 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080b24d0 0x7f930815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93080d0190 0x7f930815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f93080ce980 con 0x7f9308145970 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f93080ce800 con 0x7f93080b24d0 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f9310181640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f93080ceb00 con 0x7f93080d0190 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930e71e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930e71e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55790/0 (socket says 172.21.15.28:55790) 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.416+0000 7f930e71e640 1 -- 172.21.15.28:0/1260077986 learned_addr learned my addr 172.21.15.28:0/1260077986 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:54.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930d71c640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93080d0190 0x7f930815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930df1d640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080b24d0 0x7f930815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 -- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93080d0190 msgr2=0x7f930815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93080d0190 0x7f930815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 -- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080b24d0 msgr2=0x7f930815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080b24d0 0x7f930815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 -- 172.21.15.28:0/1260077986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308137400 con 0x7f9308145970 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930e71e640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9300019540 tx=0x7f93000196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000bc020 con 0x7f9308145970 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000b8670 con 0x7f9308145970 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081376e0 con 0x7f9308145970 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000b8a60 con 0x7f9308145970 2024-09-15T22:57:54.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308137ca0 con 0x7f9308145970 2024-09-15T22:57:54.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93080cfc50 con 0x7f9308145970 2024-09-15T22:57:54.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93000bf020 con 0x7f9308145970 2024-09-15T22:57:54.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 0x7f92ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9300120e00 con 0x7f9308145970 2024-09-15T22:57:54.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930df1d640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 0x7f92ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.420+0000 7f930df1d640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 0x7f92ec069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93040015b0 tx=0x7f9304009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.424+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93000c6030 con 0x7f9308145970 2024-09-15T22:57:54.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.592+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93080736b0 con 0x7f9308145970 2024-09-15T22:57:54.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.596+0000 7f92fe7fc640 1 -- 172.21.15.28:0/1260077986 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16754 (secure 0 0 0) 0x7f93000165e0 con 0x7f9308145970 2024-09-15T22:57:54.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:54.600 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":45,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:53.585235+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:51.317043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:52.576794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 msgr2=0x7f92ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 0x7f92ec069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93040015b0 tx=0x7f9304009040 comp rx=0 tx=0).stop 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 msgr2=0x7f930815d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9300019540 tx=0x7f93000196d0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 shutdown_connections 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9308145970 0x7f930815d500 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93080d0190 0x7f930815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f92ec0678c0 0x7f92ec069d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 --2- 172.21.15.28:0/1260077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080b24d0 0x7f930815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 >> 172.21.15.28:0/1260077986 conn(0x7f930806bcc0 msgr2=0x7f930806c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 shutdown_connections 2024-09-15T22:57:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.600+0000 7f9310181640 1 -- 172.21.15.28:0/1260077986 wait complete. 2024-09-15T22:57:54.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:54.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 Processor -- start 2024-09-15T22:57:54.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 -- start start 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f783015e820 0x7f78300cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78300d2ba0 con 0x7f78300b3610 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78300d2e80 con 0x7f783006d870 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f7835ade640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f78300d3160 con 0x7f783015e820 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f78300b3610 0x7f78300d3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59314/0 (socket says 172.21.15.28:59314) 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782ffff640 1 -- 172.21.15.28:0/516716950 learned_addr learned my addr 172.21.15.28:0/516716950 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782effd640 1 --2- 172.21.15.28:0/516716950 >> v2:172.21.15.131:3300/0 conn(0x7f783015e820 0x7f78300cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866147416 0 0) 0x7f78300d2ba0 con 0x7f78300b3610 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7818003530 con 0x7f78300b3610 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 5847253 0 0) 0x7f7818003530 con 0x7f78300b3610 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 >> v2:172.21.15.131:3300/0 conn(0x7f783015e820 msgr2=0x7f78300cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 --2- 172.21.15.28:0/516716950 >> v2:172.21.15.131:3300/0 conn(0x7f783015e820 0x7f78300cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 >> v1:172.21.15.131:6789/0 conn(0x7f783006d870 legacy=0x7f783006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300d3440 con 0x7f78300b3610 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f7828001a00 con 0x7f78300b3610 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 >> v1:172.21.15.28:6789/0 conn(0x7f78300b3610 legacy=0x7f78300d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 0x7f7818003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7818004810 0x7f7818004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78180051d0 0x7f781800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78300d3160 con 0x7f78180039c0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f781800c070 con 0x7f78180051d0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f781800c270 con 0x7f7818004810 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 0x7f7818003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782effd640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7818004810 0x7f7818004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782ffff640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78180051d0 0x7f781800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 -- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7818004810 msgr2=0x7f7818004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7818004810 0x7f7818004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 -- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78180051d0 msgr2=0x7f781800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78180051d0 0x7f781800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782f7fe640 1 -- 172.21.15.28:0/516716950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7818003530 con 0x7f78180039c0 2024-09-15T22:57:54.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782ffff640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78180051d0 0x7f781800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:54.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.736+0000 7f782ffff640 1 -- 172.21.15.28:0/516716950 reap_dead start 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f782f7fe640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 0x7f7818003de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7824001780 tx=0x7f782401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c38031231c46dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78240013a0 con 0x7f78180039c0 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78240052f0 con 0x7f78180039c0 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f782e7fc640 1 -- 172.21.15.28:0/516716950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824003840 con 0x7f78180039c0 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 -- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 msgr2=0x7f7818003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 0x7f7818003de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7824001780 tx=0x7f782401c3d0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 -- 172.21.15.28:0/516716950 shutdown_connections 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 --2- 172.21.15.28:0/516716950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78180039c0 0x7f7818003de0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 -- 172.21.15.28:0/516716950 >> 172.21.15.28:0/516716950 conn(0x7f78300d4910 msgr2=0x7f78300d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 -- 172.21.15.28:0/516716950 shutdown_connections 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.740+0000 7f7835ade640 1 -- 172.21.15.28:0/516716950 wait complete. 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 Processor -- start 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- start start 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78180039c0 0x7f78300cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 0x7f78301eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78300d4450 con 0x7f78301eb410 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f78300cfd70 con 0x7f7830155560 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f78300b7690 con 0x7f78180039c0 2024-09-15T22:57:54.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55802/0 (socket says 172.21.15.28:55802) 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 -- 172.21.15.28:0/3576667711 learned_addr learned my addr 172.21.15.28:0/3576667711 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782f7fe640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78180039c0 0x7f78300cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782effd640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 0x7f78301eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 -- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78180039c0 msgr2=0x7f78300cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78180039c0 0x7f78300cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 -- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 msgr2=0x7f78301eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 0x7f78301eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 -- 172.21.15.28:0/3576667711 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78300cd5b0 con 0x7f78301eb410 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782effd640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 0x7f78301eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782ffff640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f783015ec00 tx=0x7f782800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828004d70 con 0x7f78301eb410 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782800bb80 con 0x7f78301eb410 2024-09-15T22:57:54.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783015c990 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828007070 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78300cc870 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78301ec870 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f782801b020 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 0x7f781c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7828085ce0 con 0x7f78301eb410 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.744+0000 7f782f7fe640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 0x7f781c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:54.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.748+0000 7f782f7fe640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 0x7f781c069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7824001750 tx=0x7f78240011a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:54.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.752+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7828056820 con 0x7f78301eb410 2024-09-15T22:57:54.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.912+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f783015cee0 con 0x7f78301eb410 2024-09-15T22:57:54.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.916+0000 7f7817fff640 1 -- 172.21.15.28:0/3576667711 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16754 (secure 0 0 0) 0x7f783015cee0 con 0x7f78301eb410 2024-09-15T22:57:54.920 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:54.920 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":45,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:53.585235+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:51.317043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:52.576794+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 msgr2=0x7f781c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 0x7f781c069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7824001750 tx=0x7f78240011a0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 msgr2=0x7f783015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f783015ec00 tx=0x7f782800b4a0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 shutdown_connections 2024-09-15T22:57:54.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78301eb410 0x7f783015b680 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f781c0678c0 0x7f781c069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7830155560 0x7f78301eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 --2- 172.21.15.28:0/3576667711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78180039c0 0x7f78300cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 >> 172.21.15.28:0/3576667711 conn(0x7f78300d4910 msgr2=0x7f78300b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 shutdown_connections 2024-09-15T22:57:54.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:54.920+0000 7f7835ade640 1 -- 172.21.15.28:0/3576667711 wait complete. 2024-09-15T22:57:54.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:57:55.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 Processor -- start 2024-09-15T22:57:55.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 -- start start 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 0x7ff5740d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff5740d2710 0x7ff5740d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5740cf4d0 con 0x7ff5740d0a70 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff5740b3e30 con 0x7ff5740d2710 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5792ed640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff5740d30a0 con 0x7ff57415e630 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5737fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff5740d2710 0x7ff5740d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5727fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff5740d0a70 0x7ff5740b9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59322/0 (socket says 172.21.15.28:59322) 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5727fc640 1 -- 172.21.15.28:0/609547791 learned_addr learned my addr 172.21.15.28:0/609547791 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:55.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff572ffd640 1 --2- 172.21.15.28:0/609547791 >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 0x7ff5740d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5737fe640 1 -- 172.21.15.28:0/609547791 >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 msgr2=0x7ff5740d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:55.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5737fe640 1 --2- 172.21.15.28:0/609547791 >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 0x7ff5740d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5737fe640 1 -- 172.21.15.28:0/609547791 >> v1:172.21.15.28:6789/0 conn(0x7ff5740d0a70 legacy=0x7ff5740b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff5737fe640 1 -- 172.21.15.28:0/609547791 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5740cf770 con 0x7ff5740d2710 2024-09-15T22:57:55.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.060+0000 7ff572ffd640 1 --2- 172.21.15.28:0/609547791 >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 0x7ff5740d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:55.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5737fe640 1 --2- 172.21.15.28:0/609547791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5740d2710 0x7ff5740d2b60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff574075c20 tx=0x7ff56c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a505115dcb5c93fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:55.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff571ffb640 1 -- 172.21.15.28:0/609547791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0b2070 con 0x7ff5740d2710 2024-09-15T22:57:55.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff571ffb640 1 -- 172.21.15.28:0/609547791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c0a59c0 con 0x7ff5740d2710 2024-09-15T22:57:55.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff571ffb640 1 -- 172.21.15.28:0/609547791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0a5d90 con 0x7ff5740d2710 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- 172.21.15.28:0/609547791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5740d2710 msgr2=0x7ff5740d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- 172.21.15.28:0/609547791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5740d2710 0x7ff5740d2b60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff574075c20 tx=0x7ff56c01c900 comp rx=0 tx=0).stop 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- 172.21.15.28:0/609547791 shutdown_connections 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- 172.21.15.28:0/609547791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5740d2710 0x7ff5740d2b60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- 172.21.15.28:0/609547791 >> v2:172.21.15.131:3300/0 conn(0x7ff57415e630 0x7ff5740d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- 172.21.15.28:0/609547791 >> 172.21.15.28:0/609547791 conn(0x7ff5740d4550 msgr2=0x7ff5740d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- 172.21.15.28:0/609547791 shutdown_connections 2024-09-15T22:57:55.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- 172.21.15.28:0/609547791 wait complete. 2024-09-15T22:57:55.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 Processor -- start 2024-09-15T22:57:55.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- start start 2024-09-15T22:57:55.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5740d2710 0x7ff574154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 0x7ff5740cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5740b6af0 con 0x7ff57415e630 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5740d00d0 con 0x7ff5740d2710 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5792ed640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff57415ea10 con 0x7ff574161170 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55818/0 (socket says 172.21.15.28:55818) 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 -- 172.21.15.28:0/2648616511 learned_addr learned my addr 172.21.15.28:0/2648616511 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff572ffd640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5740d2710 0x7ff574154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5737fe640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 0x7ff5740cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 -- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 msgr2=0x7ff5740cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 0x7ff5740cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 -- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5740d2710 msgr2=0x7ff574154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5740d2710 0x7ff574154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 -- 172.21.15.28:0/2648616511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57415fa80 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5737fe640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 0x7ff5740cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.064+0000 7ff5727fc640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c530 tx=0x7ff56800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568017070 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff568005cf0 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57415fd60 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568007270 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff574160320 con 0x7ff57415e630 2024-09-15T22:57:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5740b8ee0 con 0x7ff57415e630 2024-09-15T22:57:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff56801a070 con 0x7ff57415e630 2024-09-15T22:57:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 0x7ff560069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff568084fb0 con 0x7ff57415e630 2024-09-15T22:57:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff572ffd640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 0x7ff560069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.068+0000 7ff572ffd640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 0x7ff560069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff564006fd0 tx=0x7ff564008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:55.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.072+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff568055410 con 0x7ff57415e630 2024-09-15T22:57:55.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:55.276+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff574160690 con 0x7ff57415e630 2024-09-15T22:57:56.196 INFO:tasks.ceph.mds.a.smithi028.stderr:2024-09-15T22:57:56.196+0000 7f1a9d7c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:57:56.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.252+0000 7ff55b7fe640 1 -- 172.21.15.28:0/2648616511 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7ff568059710 con 0x7ff57415e630 2024-09-15T22:57:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 msgr2=0x7ff560069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 0x7ff560069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff564006fd0 tx=0x7ff564008040 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 msgr2=0x7ff574160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c530 tx=0x7ff56800c9f0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 shutdown_connections 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff574161170 0x7ff5740cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff57415e630 0x7ff574160c30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff5600678f0 0x7ff560069db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 --2- 172.21.15.28:0/2648616511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5740d2710 0x7ff574154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 >> 172.21.15.28:0/2648616511 conn(0x7ff5740d4550 msgr2=0x7ff5741579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 shutdown_connections 2024-09-15T22:57:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.256+0000 7ff5792ed640 1 -- 172.21.15.28:0/2648616511 wait complete. 2024-09-15T22:57:56.279 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:57:56.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:57:56.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 Processor -- start 2024-09-15T22:57:56.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 -- start start 2024-09-15T22:57:56.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed780d2830 0x7fed780d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed780b3ae0 con 0x7fed7815e620 2024-09-15T22:57:56.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed780d2cc0 con 0x7fed7815ea00 2024-09-15T22:57:56.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7fdd7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fed780d2fa0 con 0x7fed780d2830 2024-09-15T22:57:56.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fed7815e620 0x7fed780b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59324/0 (socket says 172.21.15.28:59324) 2024-09-15T22:57:56.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 -- 172.21.15.28:0/1891662767 learned_addr learned my addr 172.21.15.28:0/1891662767 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7e374640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed780d2830 0x7fed780d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202785159 0 0) 0x7fed780b3ae0 con 0x7fed7815e620 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed64003530 con 0x7fed7815e620 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3723938806 0 0) 0x7fed64003530 con 0x7fed7815e620 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed780d2830 msgr2=0x7fed780d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed780d2830 0x7fed780d4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 >> v1:172.21.15.131:6789/0 conn(0x7fed7815ea00 legacy=0x7fed780b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed780d3280 con 0x7fed7815e620 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fed74001680 con 0x7fed7815e620 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7e374640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed780d2830 0x7fed780d4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 >> v1:172.21.15.28:6789/0 conn(0x7fed7815e620 legacy=0x7fed780b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed64003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed64004810 0x7fed64004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed64005150 0x7fed6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed780d2fa0 con 0x7fed640039f0 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed6400bf10 con 0x7fed64005150 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fed6400c0e0 con 0x7fed64004810 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed64003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7e374640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed64005150 0x7fed6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7d372640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed64004810 0x7fed64004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 -- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed64004810 msgr2=0x7fed64004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed64004810 0x7fed64004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 -- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed64005150 msgr2=0x7fed6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed64005150 0x7fed6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7db73640 1 -- 172.21.15.28:0/1891662767 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed64003530 con 0x7fed640039f0 2024-09-15T22:57:56.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.408+0000 7fed7d372640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed64004810 0x7fed64004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7db73640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed64003e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c270 tx=0x7fed7401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c433b36fabc74679 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74007d20 con 0x7fed640039f0 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740a9070 con 0x7fed640039f0 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7cb71640 1 -- 172.21.15.28:0/1891662767 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74005d40 con 0x7fed640039f0 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- 172.21.15.28:0/1891662767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 msgr2=0x7fed64003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/1891662767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed64003e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c270 tx=0x7fed7401cc50 comp rx=0 tx=0).stop 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7e374640 1 -- 172.21.15.28:0/1891662767 reap_dead start 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- 172.21.15.28:0/1891662767 shutdown_connections 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- 172.21.15.28:0/1891662767 >> 172.21.15.28:0/1891662767 conn(0x7fed78067e00 msgr2=0x7fed78068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- 172.21.15.28:0/1891662767 shutdown_connections 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- 172.21.15.28:0/1891662767 wait complete. 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 Processor -- start 2024-09-15T22:57:56.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.412+0000 7fed7fdd7640 1 -- start start 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 0x7fed7814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed7814ebb0 0x7fed7815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed780b6ae0 con 0x7fed640039f0 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed780b6960 con 0x7fed780c8d60 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fed780b6c60 con 0x7fed7814ebb0 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55834/0 (socket says 172.21.15.28:55834) 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 -- 172.21.15.28:0/2214718414 learned_addr learned my addr 172.21.15.28:0/2214718414 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7e374640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed7814ebb0 0x7fed7815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7d372640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 0x7fed7814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 -- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed7814ebb0 msgr2=0x7fed7815a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed7814ebb0 0x7fed7815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 -- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 msgr2=0x7fed7814e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 0x7fed7814e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 -- 172.21.15.28:0/2214718414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed780ca5a0 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7d372640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 0x7fed7814e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7db73640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c210 tx=0x7fed64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740a5890 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740a5a30 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed780ca880 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740a5de0 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed780cae40 con 0x7fed640039f0 2024-09-15T22:57:56.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed780b70a0 con 0x7fed640039f0 2024-09-15T22:57:56.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed740047f0 con 0x7fed640039f0 2024-09-15T22:57:56.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 0x7fed5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fed7411f2b0 con 0x7fed640039f0 2024-09-15T22:57:56.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7d372640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 0x7fed5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.416+0000 7fed7d372640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 0x7fed5c069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed68007fd0 tx=0x7fed68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.420+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed74016990 con 0x7fed640039f0 2024-09-15T22:57:56.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:56.616+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fed7815d5a0 con 0x7fed640039f0 2024-09-15T22:57:57.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.260+0000 7fed6e7fc640 1 -- 172.21.15.28:0/2214718414 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fed740efe80 con 0x7fed640039f0 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 msgr2=0x7fed5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 0x7fed5c069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed68007fd0 tx=0x7fed68009040 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 msgr2=0x7fed7814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c210 tx=0x7fed64005840 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 shutdown_connections 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed7814ebb0 0x7fed7815a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fed5c0678c0 0x7fed5c069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed780c8d60 0x7fed7814e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 --2- 172.21.15.28:0/2214718414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed640039f0 0x7fed7814de40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 >> 172.21.15.28:0/2214718414 conn(0x7fed78067e00 msgr2=0x7fed780b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 shutdown_connections 2024-09-15T22:57:57.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.264+0000 7fed7fdd7640 1 -- 172.21.15.28:0/2214718414 wait complete. 2024-09-15T22:57:57.288 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:57:57.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 Processor -- start 2024-09-15T22:57:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 -- start start 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde400b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde400d0360 0x7fde400cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde400d0960 con 0x7fde400b2300 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fde400d0f20 con 0x7fde400d0360 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde455dc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fde400cd620 con 0x7fde40145970 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde400d0360 0x7fde400cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde400d0360 0x7fde400cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55850/0 (socket says 172.21.15.28:55850) 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 -- 172.21.15.28:0/671199436 learned_addr learned my addr 172.21.15.28:0/671199436 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3effd640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde400b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 -- 172.21.15.28:0/671199436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 msgr2=0x7fde400b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde400b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 -- 172.21.15.28:0/671199436 >> v1:172.21.15.131:6789/0 conn(0x7fde400b2300 legacy=0x7fde400cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.412+0000 7fde3f7fe640 1 -- 172.21.15.28:0/671199436 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400d0c40 con 0x7fde400d0360 2024-09-15T22:57:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3f7fe640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400d0360 0x7fde400cdab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fde38009e50 tx=0x7fde3801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d1bfe49beb1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3e7fc640 1 -- 172.21.15.28:0/671199436 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde380a5770 con 0x7fde400d0360 2024-09-15T22:57:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3e7fc640 1 -- 172.21.15.28:0/671199436 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde380a5910 con 0x7fde400d0360 2024-09-15T22:57:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3e7fc640 1 -- 172.21.15.28:0/671199436 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde380a5ce0 con 0x7fde400d0360 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- 172.21.15.28:0/671199436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400d0360 msgr2=0x7fde400cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400d0360 0x7fde400cdab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fde38009e50 tx=0x7fde3801c9a0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- 172.21.15.28:0/671199436 shutdown_connections 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400d0360 0x7fde400cdab0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- 172.21.15.28:0/671199436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde400b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- 172.21.15.28:0/671199436 >> 172.21.15.28:0/671199436 conn(0x7fde4006bcc0 msgr2=0x7fde4006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- 172.21.15.28:0/671199436 shutdown_connections 2024-09-15T22:57:57.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- 172.21.15.28:0/671199436 wait complete. 2024-09-15T22:57:57.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 Processor -- start 2024-09-15T22:57:57.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- start start 2024-09-15T22:57:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde400d0360 0x7fde4015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde4015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde400ceb90 con 0x7fde400b2300 2024-09-15T22:57:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fde400cea10 con 0x7fde400d0360 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde455dc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fde400ced10 con 0x7fde40145970 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55862/0 (socket says 172.21.15.28:55862) 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 -- 172.21.15.28:0/1255620688 learned_addr learned my addr 172.21.15.28:0/1255620688 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3f7fe640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde4015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde37fff640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde400d0360 0x7fde4015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 -- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 msgr2=0x7fde4015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde4015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 -- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde400d0360 msgr2=0x7fde4015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde400d0360 0x7fde4015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 -- 172.21.15.28:0/1255620688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4015d6a0 con 0x7fde400b2300 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3f7fe640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde4015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.416+0000 7fde3effd640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde2800d620 tx=0x7fde2800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2800b620 con 0x7fde400b2300 2024-09-15T22:57:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde28019070 con 0x7fde400b2300 2024-09-15T22:57:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4015d980 con 0x7fde400b2300 2024-09-15T22:57:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2800b9e0 con 0x7fde400b2300 2024-09-15T22:57:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4015df40 con 0x7fde400b2300 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde400cdab0 con 0x7fde400b2300 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde2800bb80 con 0x7fde400b2300 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 0x7fde20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fde28086140 con 0x7fde400b2300 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde37fff640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 0x7fde20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.420+0000 7fde37fff640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 0x7fde20069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde40166e20 tx=0x7fde30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.424+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde28056b50 con 0x7fde400b2300 2024-09-15T22:57:57.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde4013f900 con 0x7fde400b2300 2024-09-15T22:57:57.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde377fe640 1 -- 172.21.15.28:0/1255620688 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7fde28056450 con 0x7fde400b2300 2024-09-15T22:57:57.623 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:57.623 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:57:57.623 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:57:57.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 msgr2=0x7fde20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 0x7fde20069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde40166e20 tx=0x7fde30009040 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 msgr2=0x7fde40138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde2800d620 tx=0x7fde2800dae0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 shutdown_connections 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde40145970 0x7fde4015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fde200678c0 0x7fde20069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde400d0360 0x7fde4015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 --2- 172.21.15.28:0/1255620688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde400b2300 0x7fde40138bd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 >> 172.21.15.28:0/1255620688 conn(0x7fde4006bcc0 msgr2=0x7fde4006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 shutdown_connections 2024-09-15T22:57:57.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.620+0000 7fde455dc640 1 -- 172.21.15.28:0/1255620688 wait complete. 2024-09-15T22:57:57.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:57:57.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.748+0000 7f59f0c52640 1 Processor -- start 2024-09-15T22:57:57.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 -- start start 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59ec15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f59ec0b1dc0 0x7f59ec0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec0b55e0 con 0x7f59ec0b5200 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec0ce3b0 con 0x7f59ec0b1dc0 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59f0c52640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec0b2750 con 0x7f59ec0cca90 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59ea59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f59ec0b5200 0x7f59ec0b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59330/0 (socket says 172.21.15.28:59330) 2024-09-15T22:57:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59ea59c640 1 -- 172.21.15.28:0/2353339670 learned_addr learned my addr 172.21.15.28:0/2353339670 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59ead9d640 1 --2- 172.21.15.28:0/2353339670 >> v2:172.21.15.131:3300/0 conn(0x7f59ec0b1dc0 0x7f59ec0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59ec15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212205157 0 0) 0x7f59ec0b55e0 con 0x7f59ec0b5200 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d4003530 con 0x7f59ec0b5200 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1488846529 0 0) 0x7f59d4003530 con 0x7f59ec0b5200 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 msgr2=0x7f59ec15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59ec15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 >> v2:172.21.15.131:3300/0 conn(0x7f59ec0b1dc0 msgr2=0x7f59ec0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 --2- 172.21.15.28:0/2353339670 >> v2:172.21.15.131:3300/0 conn(0x7f59ec0b1dc0 0x7f59ec0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec0cd020 con 0x7f59ec0b5200 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f59dc001a00 con 0x7f59ec0b5200 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 >> v1:172.21.15.28:6789/0 conn(0x7f59ec0b5200 legacy=0x7f59ec0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40039c0 0x7f59d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59d4004810 0x7f59d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0b2750 con 0x7f59d4004810 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59d400b9d0 con 0x7f59d40039c0 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59d400bb80 con 0x7f59ec0cca90 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59d4004810 0x7f59d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59ea59c640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40039c0 0x7f59d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59ead9d640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 -- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 msgr2=0x7f59d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:57.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59ec0cca90 0x7f59d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 -- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40039c0 msgr2=0x7f59d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:57.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59d40039c0 0x7f59d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.752+0000 7f59e9d9b640 1 -- 172.21.15.28:0/2353339670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d4003530 con 0x7f59d4004810 2024-09-15T22:57:57.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59d4004810 0x7f59d4004c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f59e00093e0 tx=0x7f59e001ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f2e59ccdb8d14c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00b4070 con 0x7f59d4004810 2024-09-15T22:57:57.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00a75a0 con 0x7f59d4004810 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59e959a640 1 -- 172.21.15.28:0/2353339670 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00096b0 con 0x7f59d4004810 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- 172.21.15.28:0/2353339670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59d4004810 msgr2=0x7f59d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2353339670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59d4004810 0x7f59d4004c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f59e00093e0 tx=0x7f59e001ec40 comp rx=0 tx=0).stop 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59ead9d640 1 -- 172.21.15.28:0/2353339670 reap_dead start 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- 172.21.15.28:0/2353339670 shutdown_connections 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- 172.21.15.28:0/2353339670 >> 172.21.15.28:0/2353339670 conn(0x7f59ec06bcc0 msgr2=0x7f59ec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- 172.21.15.28:0/2353339670 shutdown_connections 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- 172.21.15.28:0/2353339670 wait complete. 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 Processor -- start 2024-09-15T22:57:57.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- start start 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59d4004810 0x7f59ec14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59ec158190 0x7f59ec14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0b3d40 con 0x7f59ec14fc60 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec15c4c0 con 0x7f59ec158190 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59f0c52640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec0b3ec0 con 0x7f59d4004810 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59ead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59ead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55870/0 (socket says 172.21.15.28:55870) 2024-09-15T22:57:57.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.756+0000 7f59ead9d640 1 -- 172.21.15.28:0/2209008949 learned_addr learned my addr 172.21.15.28:0/2209008949 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ea59c640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59d4004810 0x7f59ec14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59e9d9b640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59ec158190 0x7f59ec14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 -- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59d4004810 msgr2=0x7f59ec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59d4004810 0x7f59ec14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 -- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59ec158190 msgr2=0x7f59ec14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59ec158190 0x7f59ec14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 -- 172.21.15.28:0/2209008949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec15b1f0 con 0x7f59ec14fc60 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ead9d640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06cc00 tx=0x7f59e4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4019020 con 0x7f59ec14fc60 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e4003620 con 0x7f59ec14fc60 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4003a50 con 0x7f59ec14fc60 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec158610 con 0x7f59ec14fc60 2024-09-15T22:57:57.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec158890 con 0x7f59ec14fc60 2024-09-15T22:57:57.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec15bdd0 con 0x7f59ec14fc60 2024-09-15T22:57:57.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59e401c020 con 0x7f59ec14fc60 2024-09-15T22:57:57.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 0x7f59cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:57.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ea59c640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 0x7f59cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:57.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f59e4085ed0 con 0x7f59ec14fc60 2024-09-15T22:57:57.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.760+0000 7f59ea59c640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 0x7f59cc069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0013e0 tx=0x7f59dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:57.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.764+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59e4023030 con 0x7f59ec14fc60 2024-09-15T22:57:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.932+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59ec0b21d0 con 0x7f59ec14fc60 2024-09-15T22:57:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.932+0000 7f59daffd640 1 -- 172.21.15.28:0/2209008949 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16741 (secure 0 0 0) 0x7f59ec158610 con 0x7f59ec14fc60 2024-09-15T22:57:57.938 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:57.938 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":46,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:57:55.245812+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:51.317043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:52.576794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 msgr2=0x7f59cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 0x7f59cc069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0013e0 tx=0x7f59dc009040 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 msgr2=0x7f59ec1500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06cc00 tx=0x7f59e4011920 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 shutdown_connections 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59ec14fc60 0x7f59ec1500e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59cc0678c0 0x7f59cc069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59ec158190 0x7f59ec14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 --2- 172.21.15.28:0/2209008949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59d4004810 0x7f59ec14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 >> 172.21.15.28:0/2209008949 conn(0x7f59ec06bcc0 msgr2=0x7f59ec15d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 shutdown_connections 2024-09-15T22:57:57.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:57.936+0000 7f59f0c52640 1 -- 172.21.15.28:0/2209008949 wait complete. 2024-09-15T22:57:57.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:57:57.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:58.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 Processor -- start 2024-09-15T22:57:58.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 -- start start 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b5200 0x7fc07815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0780b1dc0 0x7fc0780b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0780b55e0 con 0x7fc0780cca90 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc0780ce3b0 con 0x7fc0780b1dc0 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07f4de640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc0780b2750 con 0x7fc0780b5200 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07da7b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0780b1dc0 0x7fc0780b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07da7b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0780b1dc0 0x7fc0780b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55878/0 (socket says 172.21.15.28:55878) 2024-09-15T22:57:58.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07da7b640 1 -- 172.21.15.28:0/2421067156 learned_addr learned my addr 172.21.15.28:0/2421067156 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:58.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.068+0000 7fc07d27a640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b5200 0x7fc07815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07da7b640 1 -- 172.21.15.28:0/2421067156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b5200 msgr2=0x7fc07815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:58.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07da7b640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b5200 0x7fc07815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07da7b640 1 -- 172.21.15.28:0/2421067156 >> v1:172.21.15.131:6789/0 conn(0x7fc0780cca90 legacy=0x7fc0780b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:58.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07da7b640 1 -- 172.21.15.28:0/2421067156 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0780cd020 con 0x7fc0780b1dc0 2024-09-15T22:57:58.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07da7b640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b1dc0 0x7fc0780b2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc070009870 tx=0x7fc07001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1debc6444c9cbda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc077fff640 1 -- 172.21.15.28:0/2421067156 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0700b0070 con 0x7fc0780b1dc0 2024-09-15T22:57:58.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc077fff640 1 -- 172.21.15.28:0/2421067156 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0700ab600 con 0x7fc0780b1dc0 2024-09-15T22:57:58.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc077fff640 1 -- 172.21.15.28:0/2421067156 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0700ab9d0 con 0x7fc0780b1dc0 2024-09-15T22:57:58.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 -- 172.21.15.28:0/2421067156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b1dc0 msgr2=0x7fc0780b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b1dc0 0x7fc0780b2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc070009870 tx=0x7fc07001c490 comp rx=0 tx=0).stop 2024-09-15T22:57:58.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 -- 172.21.15.28:0/2421067156 shutdown_connections 2024-09-15T22:57:58.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b1dc0 0x7fc0780b2210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2421067156 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b5200 0x7fc07815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 -- 172.21.15.28:0/2421067156 >> 172.21.15.28:0/2421067156 conn(0x7fc07806bcc0 msgr2=0x7fc07806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:58.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 -- 172.21.15.28:0/2421067156 shutdown_connections 2024-09-15T22:57:58.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.072+0000 7fc07f4de640 1 -- 172.21.15.28:0/2421067156 wait complete. 2024-09-15T22:57:58.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 Processor -- start 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- start start 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b1dc0 0x7fc078152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780cca90 0x7fc07814ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0780b3ec0 con 0x7fc0780b5200 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc0780b3d40 con 0x7fc0780cca90 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc0780b4040 con 0x7fc0780b1dc0 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55880/0 (socket says 172.21.15.28:55880) 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 -- 172.21.15.28:0/2339529200 learned_addr learned my addr 172.21.15.28:0/2339529200 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07d27a640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b1dc0 0x7fc078152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07da7b640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780cca90 0x7fc07814ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 -- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b1dc0 msgr2=0x7fc078152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b1dc0 0x7fc078152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 -- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780cca90 msgr2=0x7fc07814ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780cca90 0x7fc07814ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 -- 172.21.15.28:0/2339529200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07814fec0 con 0x7fc0780b5200 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07ca79640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00b410 tx=0x7fc06c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c015030 con 0x7fc0780b5200 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c004020 con 0x7fc0780b5200 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0781501a0 con 0x7fc0780b5200 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004450 con 0x7fc0780b5200 2024-09-15T22:57:58.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc078152e60 con 0x7fc0780b5200 2024-09-15T22:57:58.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0780b2210 con 0x7fc0780b5200 2024-09-15T22:57:58.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc06c018070 con 0x7fc0780b5200 2024-09-15T22:57:58.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 0x7fc064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc06c0857c0 con 0x7fc0780b5200 2024-09-15T22:57:58.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.076+0000 7fc07d27a640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 0x7fc064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.080+0000 7fc07d27a640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 0x7fc064069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc068009f30 tx=0x7fc06800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.084+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc06c056370 con 0x7fc0780b5200 2024-09-15T22:57:58.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.232+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc07815cb10 con 0x7fc0640678c0 2024-09-15T22:57:58.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.240+0000 7fc075ffb640 1 -- 172.21.15.28:0/2339529200 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251893 (secure 0 0 0) 0x7fc07815cb10 con 0x7fc0640678c0 2024-09-15T22:57:58.247 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:58.248 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:58.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 msgr2=0x7fc064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 0x7fc064069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc068009f30 tx=0x7fc06800b040 comp rx=0 tx=0).stop 2024-09-15T22:57:58.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 msgr2=0x7fc07814f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00b410 tx=0x7fc06c00b8d0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 shutdown_connections 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0640678c0 0x7fc064069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780cca90 0x7fc07814ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0780b5200 0x7fc07814f790 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 --2- 172.21.15.28:0/2339529200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0780b1dc0 0x7fc078152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 >> 172.21.15.28:0/2339529200 conn(0x7fc07806bcc0 msgr2=0x7fc07815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 shutdown_connections 2024-09-15T22:57:58.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.244+0000 7fc07f4de640 1 -- 172.21.15.28:0/2339529200 wait complete. 2024-09-15T22:57:58.263 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-15T22:57:57.896374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5496832,"data_stored":2920807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.696444"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285911+0000","last_change":"2024-09-15T22:57:54.285363+0000","last_active":"2024-09-15T22:57:54.285911+0000","last_peered":"2024-09-15T22:57:54.285911+0000","last_clean":"2024-09-15T22:57:54.285911+0000","last_became_active":"2024-09-15T22:57:54.285025+0000","last_became_peered":"2024-09-15T22:57:54.285025+0000","last_unstale":"2024-09-15T22:57:54.285911+0000","last_undegraded":"2024-09-15T22:57:54.285911+0000","last_fullsized":"2024-09-15T22:57:54.285911+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:35.265611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291821+0000","last_change":"2024-09-15T22:57:54.289906+0000","last_active":"2024-09-15T22:57:54.291821+0000","last_peered":"2024-09-15T22:57:54.291821+0000","last_clean":"2024-09-15T22:57:54.291821+0000","last_became_active":"2024-09-15T22:57:54.289376+0000","last_became_peered":"2024-09-15T22:57:54.289376+0000","last_unstale":"2024-09-15T22:57:54.291821+0000","last_undegraded":"2024-09-15T22:57:54.291821+0000","last_fullsized":"2024-09-15T22:57:54.291821+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:40.958353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270559+0000","last_change":"2024-09-15T22:57:54.263948+0000","last_active":"2024-09-15T22:57:54.270559+0000","last_peered":"2024-09-15T22:57:54.270559+0000","last_clean":"2024-09-15T22:57:54.270559+0000","last_became_active":"2024-09-15T22:57:54.263629+0000","last_became_peered":"2024-09-15T22:57:54.263629+0000","last_unstale":"2024-09-15T22:57:54.270559+0000","last_undegraded":"2024-09-15T22:57:54.270559+0000","last_fullsized":"2024-09-15T22:57:54.270559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:19.297702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281800+0000","last_change":"2024-09-15T22:57:54.276900+0000","last_active":"2024-09-15T22:57:54.281800+0000","last_peered":"2024-09-15T22:57:54.281800+0000","last_clean":"2024-09-15T22:57:54.281800+0000","last_became_active":"2024-09-15T22:57:54.275903+0000","last_became_peered":"2024-09-15T22:57:54.275903+0000","last_unstale":"2024-09-15T22:57:54.281800+0000","last_undegraded":"2024-09-15T22:57:54.281800+0000","last_fullsized":"2024-09-15T22:57:54.281800+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:15.937215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263935+0000","last_change":"2024-09-15T22:57:54.255235+0000","last_active":"2024-09-15T22:57:54.263935+0000","last_peered":"2024-09-15T22:57:54.263935+0000","last_clean":"2024-09-15T22:57:54.263935+0000","last_became_active":"2024-09-15T22:57:54.254485+0000","last_became_peered":"2024-09-15T22:57:54.254485+0000","last_unstale":"2024-09-15T22:57:54.263935+0000","last_undegraded":"2024-09-15T22:57:54.263935+0000","last_fullsized":"2024-09-15T22:57:54.263935+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:50.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.269996+0000","last_change":"2024-09-15T22:57:54.263025+0000","last_active":"2024-09-15T22:57:54.269996+0000","last_peered":"2024-09-15T22:57:54.269996+0000","last_clean":"2024-09-15T22:57:54.269996+0000","last_became_active":"2024-09-15T22:57:54.261492+0000","last_became_peered":"2024-09-15T22:57:54.261492+0000","last_unstale":"2024-09-15T22:57:54.269996+0000","last_undegraded":"2024-09-15T22:57:54.269996+0000","last_fullsized":"2024-09-15T22:57:54.269996+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:46.541543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270582+0000","last_change":"2024-09-15T22:57:54.264707+0000","last_active":"2024-09-15T22:57:54.270582+0000","last_peered":"2024-09-15T22:57:54.270582+0000","last_clean":"2024-09-15T22:57:54.270582+0000","last_became_active":"2024-09-15T22:57:54.264428+0000","last_became_peered":"2024-09-15T22:57:54.264428+0000","last_unstale":"2024-09-15T22:57:54.270582+0000","last_undegraded":"2024-09-15T22:57:54.270582+0000","last_fullsized":"2024-09-15T22:57:54.270582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:05.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277484+0000","last_change":"2024-09-15T22:57:54.267011+0000","last_active":"2024-09-15T22:57:54.277484+0000","last_peered":"2024-09-15T22:57:54.277484+0000","last_clean":"2024-09-15T22:57:54.277484+0000","last_became_active":"2024-09-15T22:57:54.266339+0000","last_became_peered":"2024-09-15T22:57:54.266339+0000","last_unstale":"2024-09-15T22:57:54.277484+0000","last_undegraded":"2024-09-15T22:57:54.277484+0000","last_fullsized":"2024-09-15T22:57:54.277484+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:20.097398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275621+0000","last_change":"2024-09-15T22:57:54.272117+0000","last_active":"2024-09-15T22:57:54.275621+0000","last_peered":"2024-09-15T22:57:54.275621+0000","last_clean":"2024-09-15T22:57:54.275621+0000","last_became_active":"2024-09-15T22:57:54.271838+0000","last_became_peered":"2024-09-15T22:57:54.271838+0000","last_unstale":"2024-09-15T22:57:54.275621+0000","last_undegraded":"2024-09-15T22:57:54.275621+0000","last_fullsized":"2024-09-15T22:57:54.275621+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:36.154217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270227+0000","last_change":"2024-09-15T22:57:54.264035+0000","last_active":"2024-09-15T22:57:54.270227+0000","last_peered":"2024-09-15T22:57:54.270227+0000","last_clean":"2024-09-15T22:57:54.270227+0000","last_became_active":"2024-09-15T22:57:54.263378+0000","last_became_peered":"2024-09-15T22:57:54.263378+0000","last_unstale":"2024-09-15T22:57:54.270227+0000","last_undegraded":"2024-09-15T22:57:54.270227+0000","last_fullsized":"2024-09-15T22:57:54.270227+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:45.179672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.260813+0000","last_change":"2024-09-15T22:57:54.254193+0000","last_active":"2024-09-15T22:57:54.260813+0000","last_peered":"2024-09-15T22:57:54.260813+0000","last_clean":"2024-09-15T22:57:54.260813+0000","last_became_active":"2024-09-15T22:57:54.253614+0000","last_became_peered":"2024-09-15T22:57:54.253614+0000","last_unstale":"2024-09-15T22:57:54.260813+0000","last_undegraded":"2024-09-15T22:57:54.260813+0000","last_fullsized":"2024-09-15T22:57:54.260813+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:02.940578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279496+0000","last_change":"2024-09-15T22:57:54.278894+0000","last_active":"2024-09-15T22:57:54.279496+0000","last_peered":"2024-09-15T22:57:54.279496+0000","last_clean":"2024-09-15T22:57:54.279496+0000","last_became_active":"2024-09-15T22:57:54.278586+0000","last_became_peered":"2024-09-15T22:57:54.278586+0000","last_unstale":"2024-09-15T22:57:54.279496+0000","last_undegraded":"2024-09-15T22:57:54.279496+0000","last_fullsized":"2024-09-15T22:57:54.279496+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:12.079018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270267+0000","last_change":"2024-09-15T22:57:54.263366+0000","last_active":"2024-09-15T22:57:54.270267+0000","last_peered":"2024-09-15T22:57:54.270267+0000","last_clean":"2024-09-15T22:57:54.270267+0000","last_became_active":"2024-09-15T22:57:54.263049+0000","last_became_peered":"2024-09-15T22:57:54.263049+0000","last_unstale":"2024-09-15T22:57:54.270267+0000","last_undegraded":"2024-09-15T22:57:54.270267+0000","last_fullsized":"2024-09-15T22:57:54.270267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:13.986541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270082+0000","last_change":"2024-09-15T22:57:54.258424+0000","last_active":"2024-09-15T22:57:54.270082+0000","last_peered":"2024-09-15T22:57:54.270082+0000","last_clean":"2024-09-15T22:57:54.270082+0000","last_became_active":"2024-09-15T22:57:54.258125+0000","last_became_peered":"2024-09-15T22:57:54.258125+0000","last_unstale":"2024-09-15T22:57:54.270082+0000","last_undegraded":"2024-09-15T22:57:54.270082+0000","last_fullsized":"2024-09-15T22:57:54.270082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:32.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285778+0000","last_change":"2024-09-15T22:57:54.283732+0000","last_active":"2024-09-15T22:57:54.285778+0000","last_peered":"2024-09-15T22:57:54.285778+0000","last_clean":"2024-09-15T22:57:54.285778+0000","last_became_active":"2024-09-15T22:57:54.283099+0000","last_became_peered":"2024-09-15T22:57:54.283099+0000","last_unstale":"2024-09-15T22:57:54.285778+0000","last_undegraded":"2024-09-15T22:57:54.285778+0000","last_fullsized":"2024-09-15T22:57:54.285778+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:52.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.271581+0000","last_change":"2024-09-15T22:57:54.267062+0000","last_active":"2024-09-15T22:57:54.271581+0000","last_peered":"2024-09-15T22:57:54.271581+0000","last_clean":"2024-09-15T22:57:54.271581+0000","last_became_active":"2024-09-15T22:57:54.266628+0000","last_became_peered":"2024-09-15T22:57:54.266628+0000","last_unstale":"2024-09-15T22:57:54.271581+0000","last_undegraded":"2024-09-15T22:57:54.271581+0000","last_fullsized":"2024-09-15T22:57:54.271581+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.276521+0000","last_change":"2024-09-15T22:57:54.275182+0000","last_active":"2024-09-15T22:57:54.276521+0000","last_peered":"2024-09-15T22:57:54.276521+0000","last_clean":"2024-09-15T22:57:54.276521+0000","last_became_active":"2024-09-15T22:57:54.274855+0000","last_became_peered":"2024-09-15T22:57:54.274855+0000","last_unstale":"2024-09-15T22:57:54.276521+0000","last_undegraded":"2024-09-15T22:57:54.276521+0000","last_fullsized":"2024-09-15T22:57:54.276521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:54.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291862+0000","last_change":"2024-09-15T22:57:54.289911+0000","last_active":"2024-09-15T22:57:54.291862+0000","last_peered":"2024-09-15T22:57:54.291862+0000","last_clean":"2024-09-15T22:57:54.291862+0000","last_became_active":"2024-09-15T22:57:54.289396+0000","last_became_peered":"2024-09-15T22:57:54.289396+0000","last_unstale":"2024-09-15T22:57:54.291862+0000","last_undegraded":"2024-09-15T22:57:54.291862+0000","last_fullsized":"2024-09-15T22:57:54.291862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:52.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.272340+0000","last_change":"2024-09-15T22:57:54.270860+0000","last_active":"2024-09-15T22:57:54.272340+0000","last_peered":"2024-09-15T22:57:54.272340+0000","last_clean":"2024-09-15T22:57:54.272340+0000","last_became_active":"2024-09-15T22:57:54.270365+0000","last_became_peered":"2024-09-15T22:57:54.270365+0000","last_unstale":"2024-09-15T22:57:54.272340+0000","last_undegraded":"2024-09-15T22:57:54.272340+0000","last_fullsized":"2024-09-15T22:57:54.272340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:10.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282302+0000","last_change":"2024-09-15T22:57:54.267493+0000","last_active":"2024-09-15T22:57:54.282302+0000","last_peered":"2024-09-15T22:57:54.282302+0000","last_clean":"2024-09-15T22:57:54.282302+0000","last_became_active":"2024-09-15T22:57:54.266602+0000","last_became_peered":"2024-09-15T22:57:54.266602+0000","last_unstale":"2024-09-15T22:57:54.282302+0000","last_undegraded":"2024-09-15T22:57:54.282302+0000","last_fullsized":"2024-09-15T22:57:54.282302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:52.612831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.280959+0000","last_change":"2024-09-15T22:57:54.250398+0000","last_active":"2024-09-15T22:57:54.280959+0000","last_peered":"2024-09-15T22:57:54.280959+0000","last_clean":"2024-09-15T22:57:54.280959+0000","last_became_active":"2024-09-15T22:57:54.249681+0000","last_became_peered":"2024-09-15T22:57:54.249681+0000","last_unstale":"2024-09-15T22:57:54.280959+0000","last_undegraded":"2024-09-15T22:57:54.280959+0000","last_fullsized":"2024-09-15T22:57:54.280959+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:36.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275601+0000","last_change":"2024-09-15T22:57:54.272308+0000","last_active":"2024-09-15T22:57:54.275601+0000","last_peered":"2024-09-15T22:57:54.275601+0000","last_clean":"2024-09-15T22:57:54.275601+0000","last_became_active":"2024-09-15T22:57:54.272026+0000","last_became_peered":"2024-09-15T22:57:54.272026+0000","last_unstale":"2024-09-15T22:57:54.275601+0000","last_undegraded":"2024-09-15T22:57:54.275601+0000","last_fullsized":"2024-09-15T22:57:54.275601+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:05.952258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.260638+0000","last_change":"2024-09-15T22:57:54.253761+0000","last_active":"2024-09-15T22:57:54.260638+0000","last_peered":"2024-09-15T22:57:54.260638+0000","last_clean":"2024-09-15T22:57:54.260638+0000","last_became_active":"2024-09-15T22:57:54.253462+0000","last_became_peered":"2024-09-15T22:57:54.253462+0000","last_unstale":"2024-09-15T22:57:54.260638+0000","last_undegraded":"2024-09-15T22:57:54.260638+0000","last_fullsized":"2024-09-15T22:57:54.260638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:23.156976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263817+0000","last_change":"2024-09-15T22:57:54.257030+0000","last_active":"2024-09-15T22:57:54.263817+0000","last_peered":"2024-09-15T22:57:54.263817+0000","last_clean":"2024-09-15T22:57:54.263817+0000","last_became_active":"2024-09-15T22:57:54.256656+0000","last_became_peered":"2024-09-15T22:57:54.256656+0000","last_unstale":"2024-09-15T22:57:54.263817+0000","last_undegraded":"2024-09-15T22:57:54.263817+0000","last_fullsized":"2024-09-15T22:57:54.263817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:35.265611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270885+0000","last_change":"2024-09-15T22:57:54.265795+0000","last_active":"2024-09-15T22:57:54.270885+0000","last_peered":"2024-09-15T22:57:54.270885+0000","last_clean":"2024-09-15T22:57:54.270885+0000","last_became_active":"2024-09-15T22:57:54.263651+0000","last_became_peered":"2024-09-15T22:57:54.263651+0000","last_unstale":"2024-09-15T22:57:54.270885+0000","last_undegraded":"2024-09-15T22:57:54.270885+0000","last_fullsized":"2024-09-15T22:57:54.270885+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:26.331963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.265329+0000","last_change":"2024-09-15T22:57:54.263310+0000","last_active":"2024-09-15T22:57:54.265329+0000","last_peered":"2024-09-15T22:57:54.265329+0000","last_clean":"2024-09-15T22:57:54.265329+0000","last_became_active":"2024-09-15T22:57:54.262926+0000","last_became_peered":"2024-09-15T22:57:54.262926+0000","last_unstale":"2024-09-15T22:57:54.265329+0000","last_undegraded":"2024-09-15T22:57:54.265329+0000","last_fullsized":"2024-09-15T22:57:54.265329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:42.810706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.271585+0000","last_change":"2024-09-15T22:57:54.267313+0000","last_active":"2024-09-15T22:57:54.271585+0000","last_peered":"2024-09-15T22:57:54.271585+0000","last_clean":"2024-09-15T22:57:54.271585+0000","last_became_active":"2024-09-15T22:57:54.266473+0000","last_became_peered":"2024-09-15T22:57:54.266473+0000","last_unstale":"2024-09-15T22:57:54.271585+0000","last_undegraded":"2024-09-15T22:57:54.271585+0000","last_fullsized":"2024-09-15T22:57:54.271585+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281075+0000","last_change":"2024-09-15T22:57:54.251582+0000","last_active":"2024-09-15T22:57:54.281075+0000","last_peered":"2024-09-15T22:57:54.281075+0000","last_clean":"2024-09-15T22:57:54.281075+0000","last_became_active":"2024-09-15T22:57:54.250807+0000","last_became_peered":"2024-09-15T22:57:54.250807+0000","last_unstale":"2024-09-15T22:57:54.281075+0000","last_undegraded":"2024-09-15T22:57:54.281075+0000","last_fullsized":"2024-09-15T22:57:54.281075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:41.920408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285329+0000","last_change":"2024-09-15T22:57:54.284373+0000","last_active":"2024-09-15T22:57:54.285329+0000","last_peered":"2024-09-15T22:57:54.285329+0000","last_clean":"2024-09-15T22:57:54.285329+0000","last_became_active":"2024-09-15T22:57:54.284049+0000","last_became_peered":"2024-09-15T22:57:54.284049+0000","last_unstale":"2024-09-15T22:57:54.285329+0000","last_undegraded":"2024-09-15T22:57:54.285329+0000","last_fullsized":"2024-09-15T22:57:54.285329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:04.072882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282833+0000","last_change":"2024-09-15T22:57:54.278384+0000","last_active":"2024-09-15T22:57:54.282833+0000","last_peered":"2024-09-15T22:57:54.282833+0000","last_clean":"2024-09-15T22:57:54.282833+0000","last_became_active":"2024-09-15T22:57:54.276018+0000","last_became_peered":"2024-09-15T22:57:54.276018+0000","last_unstale":"2024-09-15T22:57:54.282833+0000","last_undegraded":"2024-09-15T22:57:54.282833+0000","last_fullsized":"2024-09-15T22:57:54.282833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:33.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270552+0000","last_change":"2024-09-15T22:57:54.264143+0000","last_active":"2024-09-15T22:57:54.270552+0000","last_peered":"2024-09-15T22:57:54.270552+0000","last_clean":"2024-09-15T22:57:54.270552+0000","last_became_active":"2024-09-15T22:57:54.263827+0000","last_became_peered":"2024-09-15T22:57:54.263827+0000","last_unstale":"2024-09-15T22:57:54.270552+0000","last_undegraded":"2024-09-15T22:57:54.270552+0000","last_fullsized":"2024-09-15T22:57:54.270552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:46.744117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278485+0000","last_change":"2024-09-15T22:57:54.261405+0000","last_active":"2024-09-15T22:57:54.278485+0000","last_peered":"2024-09-15T22:57:54.278485+0000","last_clean":"2024-09-15T22:57:54.278485+0000","last_became_active":"2024-09-15T22:57:54.257134+0000","last_became_peered":"2024-09-15T22:57:54.257134+0000","last_unstale":"2024-09-15T22:57:54.278485+0000","last_undegraded":"2024-09-15T22:57:54.278485+0000","last_fullsized":"2024-09-15T22:57:54.278485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:04.272611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291698+0000","last_change":"2024-09-15T22:57:54.287654+0000","last_active":"2024-09-15T22:57:54.291698+0000","last_peered":"2024-09-15T22:57:54.291698+0000","last_clean":"2024-09-15T22:57:54.291698+0000","last_became_active":"2024-09-15T22:57:54.287152+0000","last_became_peered":"2024-09-15T22:57:54.287152+0000","last_unstale":"2024-09-15T22:57:54.291698+0000","last_undegraded":"2024-09-15T22:57:54.291698+0000","last_fullsized":"2024-09-15T22:57:54.291698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.463302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"45'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.283001+0000","last_change":"2024-09-15T22:57:53.230201+0000","last_active":"2024-09-15T22:57:54.283001+0000","last_peered":"2024-09-15T22:57:54.283001+0000","last_clean":"2024-09-15T22:57:54.283001+0000","last_became_active":"2024-09-15T22:57:53.229476+0000","last_became_peered":"2024-09-15T22:57:53.229476+0000","last_unstale":"2024-09-15T22:57:54.283001+0000","last_undegraded":"2024-09-15T22:57:54.283001+0000","last_fullsized":"2024-09-15T22:57:54.283001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:38.538087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278879+0000","last_change":"2024-09-15T22:57:54.275511+0000","last_active":"2024-09-15T22:57:54.278879+0000","last_peered":"2024-09-15T22:57:54.278879+0000","last_clean":"2024-09-15T22:57:54.278879+0000","last_became_active":"2024-09-15T22:57:54.274845+0000","last_became_peered":"2024-09-15T22:57:54.274845+0000","last_unstale":"2024-09-15T22:57:54.278879+0000","last_undegraded":"2024-09-15T22:57:54.278879+0000","last_fullsized":"2024-09-15T22:57:54.278879+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:05.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.274694+0000","last_change":"2024-09-15T22:57:53.245726+0000","last_active":"2024-09-15T22:57:54.274694+0000","last_peered":"2024-09-15T22:57:54.274694+0000","last_clean":"2024-09-15T22:57:54.274694+0000","last_became_active":"2024-09-15T22:57:53.244009+0000","last_became_peered":"2024-09-15T22:57:53.244009+0000","last_unstale":"2024-09-15T22:57:54.274694+0000","last_undegraded":"2024-09-15T22:57:54.274694+0000","last_fullsized":"2024-09-15T22:57:54.274694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:42.788745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281718+0000","last_change":"2024-09-15T22:57:54.254040+0000","last_active":"2024-09-15T22:57:54.281718+0000","last_peered":"2024-09-15T22:57:54.281718+0000","last_clean":"2024-09-15T22:57:54.281718+0000","last_became_active":"2024-09-15T22:57:54.253224+0000","last_became_peered":"2024-09-15T22:57:54.253224+0000","last_unstale":"2024-09-15T22:57:54.281718+0000","last_undegraded":"2024-09-15T22:57:54.281718+0000","last_fullsized":"2024-09-15T22:57:54.281718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:28.625926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.284955+0000","last_change":"2024-09-15T22:57:53.236601+0000","last_active":"2024-09-15T22:57:54.284955+0000","last_peered":"2024-09-15T22:57:54.284955+0000","last_clean":"2024-09-15T22:57:54.284955+0000","last_became_active":"2024-09-15T22:57:53.235946+0000","last_became_peered":"2024-09-15T22:57:53.235946+0000","last_unstale":"2024-09-15T22:57:54.284955+0000","last_undegraded":"2024-09-15T22:57:54.284955+0000","last_fullsized":"2024-09-15T22:57:54.284955+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:01.134725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268888+0000","last_change":"2024-09-15T22:57:54.266179+0000","last_active":"2024-09-15T22:57:54.268888+0000","last_peered":"2024-09-15T22:57:54.268888+0000","last_clean":"2024-09-15T22:57:54.268888+0000","last_became_active":"2024-09-15T22:57:54.265839+0000","last_became_peered":"2024-09-15T22:57:54.265839+0000","last_unstale":"2024-09-15T22:57:54.268888+0000","last_undegraded":"2024-09-15T22:57:54.268888+0000","last_fullsized":"2024-09-15T22:57:54.268888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:45.163769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277482+0000","last_change":"2024-09-15T22:57:53.229462+0000","last_active":"2024-09-15T22:57:54.277482+0000","last_peered":"2024-09-15T22:57:54.277482+0000","last_clean":"2024-09-15T22:57:54.277482+0000","last_became_active":"2024-09-15T22:57:53.228775+0000","last_became_peered":"2024-09-15T22:57:53.228775+0000","last_unstale":"2024-09-15T22:57:54.277482+0000","last_undegraded":"2024-09-15T22:57:54.277482+0000","last_fullsized":"2024-09-15T22:57:54.277482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:34.255656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270777+0000","last_change":"2024-09-15T22:57:54.266824+0000","last_active":"2024-09-15T22:57:54.270777+0000","last_peered":"2024-09-15T22:57:54.270777+0000","last_clean":"2024-09-15T22:57:54.270777+0000","last_became_active":"2024-09-15T22:57:54.266123+0000","last_became_peered":"2024-09-15T22:57:54.266123+0000","last_unstale":"2024-09-15T22:57:54.270777+0000","last_undegraded":"2024-09-15T22:57:54.270777+0000","last_fullsized":"2024-09-15T22:57:54.270777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268512+0000","last_change":"2024-09-15T22:57:53.238086+0000","last_active":"2024-09-15T22:57:54.268512+0000","last_peered":"2024-09-15T22:57:54.268512+0000","last_clean":"2024-09-15T22:57:54.268512+0000","last_became_active":"2024-09-15T22:57:53.237241+0000","last_became_peered":"2024-09-15T22:57:53.237241+0000","last_unstale":"2024-09-15T22:57:54.268512+0000","last_undegraded":"2024-09-15T22:57:54.268512+0000","last_fullsized":"2024-09-15T22:57:54.268512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:44.169717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282763+0000","last_change":"2024-09-15T22:57:54.277739+0000","last_active":"2024-09-15T22:57:54.282763+0000","last_peered":"2024-09-15T22:57:54.282763+0000","last_clean":"2024-09-15T22:57:54.282763+0000","last_became_active":"2024-09-15T22:57:54.277175+0000","last_became_peered":"2024-09-15T22:57:54.277175+0000","last_unstale":"2024-09-15T22:57:54.282763+0000","last_undegraded":"2024-09-15T22:57:54.282763+0000","last_fullsized":"2024-09-15T22:57:54.282763+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:04.072882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.283634+0000","last_change":"2024-09-15T22:57:53.229464+0000","last_active":"2024-09-15T22:57:54.283634+0000","last_peered":"2024-09-15T22:57:54.283634+0000","last_clean":"2024-09-15T22:57:54.283634+0000","last_became_active":"2024-09-15T22:57:53.228724+0000","last_became_peered":"2024-09-15T22:57:53.228724+0000","last_unstale":"2024-09-15T22:57:54.283634+0000","last_undegraded":"2024-09-15T22:57:54.283634+0000","last_fullsized":"2024-09-15T22:57:54.283634+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.531587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263167+0000","last_change":"2024-09-15T22:57:54.260008+0000","last_active":"2024-09-15T22:57:54.263167+0000","last_peered":"2024-09-15T22:57:54.263167+0000","last_clean":"2024-09-15T22:57:54.263167+0000","last_became_active":"2024-09-15T22:57:54.259709+0000","last_became_peered":"2024-09-15T22:57:54.259709+0000","last_unstale":"2024-09-15T22:57:54.263167+0000","last_undegraded":"2024-09-15T22:57:54.263167+0000","last_fullsized":"2024-09-15T22:57:54.263167+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:36.217120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.234799+0000","last_change":"2024-09-15T22:57:53.238192+0000","last_active":"2024-09-15T22:57:54.234799+0000","last_peered":"2024-09-15T22:57:54.234799+0000","last_clean":"2024-09-15T22:57:54.234799+0000","last_became_active":"2024-09-15T22:57:53.237470+0000","last_became_peered":"2024-09-15T22:57:53.237470+0000","last_unstale":"2024-09-15T22:57:54.234799+0000","last_undegraded":"2024-09-15T22:57:54.234799+0000","last_fullsized":"2024-09-15T22:57:54.234799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:57.937279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282825+0000","last_change":"2024-09-15T22:57:54.279091+0000","last_active":"2024-09-15T22:57:54.282825+0000","last_peered":"2024-09-15T22:57:54.282825+0000","last_clean":"2024-09-15T22:57:54.282825+0000","last_became_active":"2024-09-15T22:57:54.278407+0000","last_became_peered":"2024-09-15T22:57:54.278407+0000","last_unstale":"2024-09-15T22:57:54.282825+0000","last_undegraded":"2024-09-15T22:57:54.282825+0000","last_fullsized":"2024-09-15T22:57:54.282825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:58.932541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238633+0000","last_change":"2024-09-15T22:57:53.237831+0000","last_active":"2024-09-15T22:57:54.238633+0000","last_peered":"2024-09-15T22:57:54.238633+0000","last_clean":"2024-09-15T22:57:54.238633+0000","last_became_active":"2024-09-15T22:57:53.237164+0000","last_became_peered":"2024-09-15T22:57:53.237164+0000","last_unstale":"2024-09-15T22:57:54.238633+0000","last_undegraded":"2024-09-15T22:57:54.238633+0000","last_fullsized":"2024-09-15T22:57:54.238633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:03.918355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.273479+0000","last_change":"2024-09-15T22:57:54.265174+0000","last_active":"2024-09-15T22:57:54.273479+0000","last_peered":"2024-09-15T22:57:54.273479+0000","last_clean":"2024-09-15T22:57:54.273479+0000","last_became_active":"2024-09-15T22:57:54.262152+0000","last_became_peered":"2024-09-15T22:57:54.262152+0000","last_unstale":"2024-09-15T22:57:54.273479+0000","last_undegraded":"2024-09-15T22:57:54.273479+0000","last_fullsized":"2024-09-15T22:57:54.273479+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:15.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.259300+0000","last_change":"2024-09-15T22:57:53.237254+0000","last_active":"2024-09-15T22:57:54.259300+0000","last_peered":"2024-09-15T22:57:54.259300+0000","last_clean":"2024-09-15T22:57:54.259300+0000","last_became_active":"2024-09-15T22:57:53.236384+0000","last_became_peered":"2024-09-15T22:57:53.236384+0000","last_unstale":"2024-09-15T22:57:54.259300+0000","last_undegraded":"2024-09-15T22:57:54.259300+0000","last_fullsized":"2024-09-15T22:57:54.259300+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:53.067810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.258051+0000","last_change":"2024-09-15T22:57:54.248081+0000","last_active":"2024-09-15T22:57:54.258051+0000","last_peered":"2024-09-15T22:57:54.258051+0000","last_clean":"2024-09-15T22:57:54.258051+0000","last_became_active":"2024-09-15T22:57:54.247384+0000","last_became_peered":"2024-09-15T22:57:54.247384+0000","last_unstale":"2024-09-15T22:57:54.258051+0000","last_undegraded":"2024-09-15T22:57:54.258051+0000","last_fullsized":"2024-09-15T22:57:54.258051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:32.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254000+0000","last_change":"2024-09-15T22:57:53.243239+0000","last_active":"2024-09-15T22:57:54.254000+0000","last_peered":"2024-09-15T22:57:54.254000+0000","last_clean":"2024-09-15T22:57:54.254000+0000","last_became_active":"2024-09-15T22:57:53.242559+0000","last_became_peered":"2024-09-15T22:57:53.242559+0000","last_unstale":"2024-09-15T22:57:54.254000+0000","last_undegraded":"2024-09-15T22:57:54.254000+0000","last_fullsized":"2024-09-15T22:57:54.254000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:44.169717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275486+0000","last_change":"2024-09-15T22:57:54.274182+0000","last_active":"2024-09-15T22:57:54.275486+0000","last_peered":"2024-09-15T22:57:54.275486+0000","last_clean":"2024-09-15T22:57:54.275486+0000","last_became_active":"2024-09-15T22:57:54.273899+0000","last_became_peered":"2024-09-15T22:57:54.273899+0000","last_unstale":"2024-09-15T22:57:54.275486+0000","last_undegraded":"2024-09-15T22:57:54.275486+0000","last_fullsized":"2024-09-15T22:57:54.275486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:17.990117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"45'3","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279907+0000","last_change":"2024-09-15T22:57:53.239653+0000","last_active":"2024-09-15T22:57:54.279907+0000","last_peered":"2024-09-15T22:57:54.279907+0000","last_clean":"2024-09-15T22:57:54.279907+0000","last_became_active":"2024-09-15T22:57:53.238395+0000","last_became_peered":"2024-09-15T22:57:53.238395+0000","last_unstale":"2024-09-15T22:57:54.279907+0000","last_undegraded":"2024-09-15T22:57:54.279907+0000","last_fullsized":"2024-09-15T22:57:54.279907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:09.178058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268132+0000","last_change":"2024-09-15T22:57:54.263125+0000","last_active":"2024-09-15T22:57:54.268132+0000","last_peered":"2024-09-15T22:57:54.268132+0000","last_clean":"2024-09-15T22:57:54.268132+0000","last_became_active":"2024-09-15T22:57:54.262040+0000","last_became_peered":"2024-09-15T22:57:54.262040+0000","last_unstale":"2024-09-15T22:57:54.268132+0000","last_undegraded":"2024-09-15T22:57:54.268132+0000","last_fullsized":"2024-09-15T22:57:54.268132+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:01.453335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"45'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277994+0000","last_change":"2024-09-15T22:57:53.230234+0000","last_active":"2024-09-15T22:57:54.277994+0000","last_peered":"2024-09-15T22:57:54.277994+0000","last_clean":"2024-09-15T22:57:54.277994+0000","last_became_active":"2024-09-15T22:57:53.229849+0000","last_became_peered":"2024-09-15T22:57:53.229849+0000","last_unstale":"2024-09-15T22:57:54.277994+0000","last_undegraded":"2024-09-15T22:57:54.277994+0000","last_fullsized":"2024-09-15T22:57:54.277994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:51.785303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285692+0000","last_change":"2024-09-15T22:57:54.281318+0000","last_active":"2024-09-15T22:57:54.285692+0000","last_peered":"2024-09-15T22:57:54.285692+0000","last_clean":"2024-09-15T22:57:54.285692+0000","last_became_active":"2024-09-15T22:57:54.280664+0000","last_became_peered":"2024-09-15T22:57:54.280664+0000","last_unstale":"2024-09-15T22:57:54.285692+0000","last_undegraded":"2024-09-15T22:57:54.285692+0000","last_fullsized":"2024-09-15T22:57:54.285692+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:26.331963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282019+0000","last_change":"2024-09-15T22:57:53.235098+0000","last_active":"2024-09-15T22:57:54.282019+0000","last_peered":"2024-09-15T22:57:54.282019+0000","last_clean":"2024-09-15T22:57:54.282019+0000","last_became_active":"2024-09-15T22:57:53.234635+0000","last_became_peered":"2024-09-15T22:57:53.234635+0000","last_unstale":"2024-09-15T22:57:54.282019+0000","last_undegraded":"2024-09-15T22:57:54.282019+0000","last_fullsized":"2024-09-15T22:57:54.282019+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:49.499626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.261776+0000","last_change":"2024-09-15T22:57:54.254981+0000","last_active":"2024-09-15T22:57:54.261776+0000","last_peered":"2024-09-15T22:57:54.261776+0000","last_clean":"2024-09-15T22:57:54.261776+0000","last_became_active":"2024-09-15T22:57:54.254684+0000","last_became_peered":"2024-09-15T22:57:54.254684+0000","last_unstale":"2024-09-15T22:57:54.261776+0000","last_undegraded":"2024-09-15T22:57:54.261776+0000","last_fullsized":"2024-09-15T22:57:54.261776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.233252+0000","last_change":"2024-09-15T22:57:53.244788+0000","last_active":"2024-09-15T22:57:54.233252+0000","last_peered":"2024-09-15T22:57:54.233252+0000","last_clean":"2024-09-15T22:57:54.233252+0000","last_became_active":"2024-09-15T22:57:53.243954+0000","last_became_peered":"2024-09-15T22:57:53.243954+0000","last_unstale":"2024-09-15T22:57:54.233252+0000","last_undegraded":"2024-09-15T22:57:54.233252+0000","last_fullsized":"2024-09-15T22:57:54.233252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:15.631993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254711+0000","last_change":"2024-09-15T22:57:54.249573+0000","last_active":"2024-09-15T22:57:54.254711+0000","last_peered":"2024-09-15T22:57:54.254711+0000","last_clean":"2024-09-15T22:57:54.254711+0000","last_became_active":"2024-09-15T22:57:54.249068+0000","last_became_peered":"2024-09-15T22:57:54.249068+0000","last_unstale":"2024-09-15T22:57:54.254711+0000","last_undegraded":"2024-09-15T22:57:54.254711+0000","last_fullsized":"2024-09-15T22:57:54.254711+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.463302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.252604+0000","last_change":"2024-09-15T22:57:53.235162+0000","last_active":"2024-09-15T22:57:54.252604+0000","last_peered":"2024-09-15T22:57:54.252604+0000","last_clean":"2024-09-15T22:57:54.252604+0000","last_became_active":"2024-09-15T22:57:53.234238+0000","last_became_peered":"2024-09-15T22:57:53.234238+0000","last_unstale":"2024-09-15T22:57:54.252604+0000","last_undegraded":"2024-09-15T22:57:54.252604+0000","last_fullsized":"2024-09-15T22:57:54.252604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:25.322008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277065+0000","last_change":"2024-09-15T22:57:54.276592+0000","last_active":"2024-09-15T22:57:54.277065+0000","last_peered":"2024-09-15T22:57:54.277065+0000","last_clean":"2024-09-15T22:57:54.277065+0000","last_became_active":"2024-09-15T22:57:54.276247+0000","last_became_peered":"2024-09-15T22:57:54.276247+0000","last_unstale":"2024-09-15T22:57:54.277065+0000","last_undegraded":"2024-09-15T22:57:54.277065+0000","last_fullsized":"2024-09-15T22:57:54.277065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:15.937215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"45'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278163+0000","last_change":"2024-09-15T22:57:53.241159+0000","last_active":"2024-09-15T22:57:54.278163+0000","last_peered":"2024-09-15T22:57:54.278163+0000","last_clean":"2024-09-15T22:57:54.278163+0000","last_became_active":"2024-09-15T22:57:53.240701+0000","last_became_peered":"2024-09-15T22:57:53.240701+0000","last_unstale":"2024-09-15T22:57:54.278163+0000","last_undegraded":"2024-09-15T22:57:54.278163+0000","last_fullsized":"2024-09-15T22:57:54.278163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:03.062927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254753+0000","last_change":"2024-09-15T22:57:54.250567+0000","last_active":"2024-09-15T22:57:54.254753+0000","last_peered":"2024-09-15T22:57:54.254753+0000","last_clean":"2024-09-15T22:57:54.254753+0000","last_became_active":"2024-09-15T22:57:54.250069+0000","last_became_peered":"2024-09-15T22:57:54.250069+0000","last_unstale":"2024-09-15T22:57:54.254753+0000","last_undegraded":"2024-09-15T22:57:54.254753+0000","last_fullsized":"2024-09-15T22:57:54.254753+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:40.958353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.273696+0000","last_change":"2024-09-15T22:57:53.234036+0000","last_active":"2024-09-15T22:57:54.273696+0000","last_peered":"2024-09-15T22:57:54.273696+0000","last_clean":"2024-09-15T22:57:54.273696+0000","last_became_active":"2024-09-15T22:57:53.228729+0000","last_became_peered":"2024-09-15T22:57:53.228729+0000","last_unstale":"2024-09-15T22:57:54.273696+0000","last_undegraded":"2024-09-15T22:57:54.273696+0000","last_fullsized":"2024-09-15T22:57:54.273696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:14.128641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270185+0000","last_change":"2024-09-15T22:57:54.266030+0000","last_active":"2024-09-15T22:57:54.270185+0000","last_peered":"2024-09-15T22:57:54.270185+0000","last_clean":"2024-09-15T22:57:54.270185+0000","last_became_active":"2024-09-15T22:57:54.265722+0000","last_became_peered":"2024-09-15T22:57:54.265722+0000","last_unstale":"2024-09-15T22:57:54.270185+0000","last_undegraded":"2024-09-15T22:57:54.270185+0000","last_fullsized":"2024-09-15T22:57:54.270185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:15.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.290836+0000","last_change":"2024-09-15T22:57:53.236609+0000","last_active":"2024-09-15T22:57:54.290836+0000","last_peered":"2024-09-15T22:57:54.290836+0000","last_clean":"2024-09-15T22:57:54.290836+0000","last_became_active":"2024-09-15T22:57:53.236196+0000","last_became_peered":"2024-09-15T22:57:53.236196+0000","last_unstale":"2024-09-15T22:57:54.290836+0000","last_undegraded":"2024-09-15T22:57:54.290836+0000","last_fullsized":"2024-09-15T22:57:54.290836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:39.654871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279806+0000","last_change":"2024-09-15T22:57:54.276327+0000","last_active":"2024-09-15T22:57:54.279806+0000","last_peered":"2024-09-15T22:57:54.279806+0000","last_clean":"2024-09-15T22:57:54.279806+0000","last_became_active":"2024-09-15T22:57:54.275609+0000","last_became_peered":"2024-09-15T22:57:54.275609+0000","last_unstale":"2024-09-15T22:57:54.279806+0000","last_undegraded":"2024-09-15T22:57:54.279806+0000","last_fullsized":"2024-09-15T22:57:54.279806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282085+0000","last_change":"2024-09-15T22:57:53.232328+0000","last_active":"2024-09-15T22:57:54.282085+0000","last_peered":"2024-09-15T22:57:54.282085+0000","last_clean":"2024-09-15T22:57:54.282085+0000","last_became_active":"2024-09-15T22:57:53.231472+0000","last_became_peered":"2024-09-15T22:57:53.231472+0000","last_unstale":"2024-09-15T22:57:54.282085+0000","last_undegraded":"2024-09-15T22:57:54.282085+0000","last_fullsized":"2024-09-15T22:57:54.282085+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:19.933878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.250266+0000","last_change":"2024-09-15T22:57:54.247880+0000","last_active":"2024-09-15T22:57:54.250266+0000","last_peered":"2024-09-15T22:57:54.250266+0000","last_clean":"2024-09-15T22:57:54.250266+0000","last_became_active":"2024-09-15T22:57:54.247570+0000","last_became_peered":"2024-09-15T22:57:54.247570+0000","last_unstale":"2024-09-15T22:57:54.250266+0000","last_undegraded":"2024-09-15T22:57:54.250266+0000","last_fullsized":"2024-09-15T22:57:54.250266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:04.928310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.232810+0000","last_change":"2024-09-15T22:57:53.242670+0000","last_active":"2024-09-15T22:57:54.232810+0000","last_peered":"2024-09-15T22:57:54.232810+0000","last_clean":"2024-09-15T22:57:54.232810+0000","last_became_active":"2024-09-15T22:57:53.241739+0000","last_became_peered":"2024-09-15T22:57:53.241739+0000","last_unstale":"2024-09-15T22:57:54.232810+0000","last_undegraded":"2024-09-15T22:57:54.232810+0000","last_fullsized":"2024-09-15T22:57:54.232810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:14.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277293+0000","last_change":"2024-09-15T22:57:54.271394+0000","last_active":"2024-09-15T22:57:54.277293+0000","last_peered":"2024-09-15T22:57:54.277293+0000","last_clean":"2024-09-15T22:57:54.277293+0000","last_became_active":"2024-09-15T22:57:54.270688+0000","last_became_peered":"2024-09-15T22:57:54.270688+0000","last_unstale":"2024-09-15T22:57:54.277293+0000","last_undegraded":"2024-09-15T22:57:54.277293+0000","last_fullsized":"2024-09-15T22:57:54.277293+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:46.744117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.292862+0000","last_change":"2024-09-15T22:57:53.240336+0000","last_active":"2024-09-15T22:57:54.292862+0000","last_peered":"2024-09-15T22:57:54.292862+0000","last_clean":"2024-09-15T22:57:54.292862+0000","last_became_active":"2024-09-15T22:57:53.238390+0000","last_became_peered":"2024-09-15T22:57:53.238390+0000","last_unstale":"2024-09-15T22:57:54.292862+0000","last_undegraded":"2024-09-15T22:57:54.292862+0000","last_fullsized":"2024-09-15T22:57:54.292862+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:19.596823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282206+0000","last_change":"2024-09-15T22:57:54.264219+0000","last_active":"2024-09-15T22:57:54.282206+0000","last_peered":"2024-09-15T22:57:54.282206+0000","last_clean":"2024-09-15T22:57:54.282206+0000","last_became_active":"2024-09-15T22:57:54.263480+0000","last_became_peered":"2024-09-15T22:57:54.263480+0000","last_unstale":"2024-09-15T22:57:54.282206+0000","last_undegraded":"2024-09-15T22:57:54.282206+0000","last_fullsized":"2024-09-15T22:57:54.282206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:35.223864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238360+0000","last_change":"2024-09-15T22:57:53.236601+0000","last_active":"2024-09-15T22:57:54.238360+0000","last_peered":"2024-09-15T22:57:54.238360+0000","last_clean":"2024-09-15T22:57:54.238360+0000","last_became_active":"2024-09-15T22:57:53.235945+0000","last_became_peered":"2024-09-15T22:57:53.235945+0000","last_unstale":"2024-09-15T22:57:54.238360+0000","last_undegraded":"2024-09-15T22:57:54.238360+0000","last_fullsized":"2024-09-15T22:57:54.238360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:14.927260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285333+0000","last_change":"2024-09-15T22:57:54.284446+0000","last_active":"2024-09-15T22:57:54.285333+0000","last_peered":"2024-09-15T22:57:54.285333+0000","last_clean":"2024-09-15T22:57:54.285333+0000","last_became_active":"2024-09-15T22:57:54.284097+0000","last_became_peered":"2024-09-15T22:57:54.284097+0000","last_unstale":"2024-09-15T22:57:54.285333+0000","last_undegraded":"2024-09-15T22:57:54.285333+0000","last_fullsized":"2024-09-15T22:57:54.285333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:33.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.253020+0000","last_change":"2024-09-15T22:57:53.234169+0000","last_active":"2024-09-15T22:57:54.253020+0000","last_peered":"2024-09-15T22:57:54.253020+0000","last_clean":"2024-09-15T22:57:54.253020+0000","last_became_active":"2024-09-15T22:57:53.233781+0000","last_became_peered":"2024-09-15T22:57:53.233781+0000","last_unstale":"2024-09-15T22:57:54.253020+0000","last_undegraded":"2024-09-15T22:57:54.253020+0000","last_fullsized":"2024-09-15T22:57:54.253020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:12.976585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270162+0000","last_change":"2024-09-15T22:57:54.264812+0000","last_active":"2024-09-15T22:57:54.270162+0000","last_peered":"2024-09-15T22:57:54.270162+0000","last_clean":"2024-09-15T22:57:54.270162+0000","last_became_active":"2024-09-15T22:57:54.261560+0000","last_became_peered":"2024-09-15T22:57:54.261560+0000","last_unstale":"2024-09-15T22:57:54.270162+0000","last_undegraded":"2024-09-15T22:57:54.270162+0000","last_fullsized":"2024-09-15T22:57:54.270162+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:01.453335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.230854+0000","last_change":"2024-09-15T22:57:53.213417+0000","last_active":"2024-09-15T22:57:54.230854+0000","last_peered":"2024-09-15T22:57:54.230854+0000","last_clean":"2024-09-15T22:57:54.230854+0000","last_became_active":"2024-09-15T22:57:53.213004+0000","last_became_peered":"2024-09-15T22:57:53.213004+0000","last_unstale":"2024-09-15T22:57:54.230854+0000","last_undegraded":"2024-09-15T22:57:54.230854+0000","last_fullsized":"2024-09-15T22:57:54.230854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:56.156115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.274254+0000","last_change":"2024-09-15T22:57:54.262051+0000","last_active":"2024-09-15T22:57:54.274254+0000","last_peered":"2024-09-15T22:57:54.274254+0000","last_clean":"2024-09-15T22:57:54.274254+0000","last_became_active":"2024-09-15T22:57:54.261322+0000","last_became_peered":"2024-09-15T22:57:54.261322+0000","last_unstale":"2024-09-15T22:57:54.274254+0000","last_undegraded":"2024-09-15T22:57:54.274254+0000","last_fullsized":"2024-09-15T22:57:54.274254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:19.297702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282904+0000","last_change":"2024-09-15T22:57:53.242843+0000","last_active":"2024-09-15T22:57:54.282904+0000","last_peered":"2024-09-15T22:57:54.282904+0000","last_clean":"2024-09-15T22:57:54.282904+0000","last_became_active":"2024-09-15T22:57:53.242106+0000","last_became_peered":"2024-09-15T22:57:53.242106+0000","last_unstale":"2024-09-15T22:57:54.282904+0000","last_undegraded":"2024-09-15T22:57:54.282904+0000","last_fullsized":"2024-09-15T22:57:54.282904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:04.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270282+0000","last_change":"2024-09-15T22:57:54.264680+0000","last_active":"2024-09-15T22:57:54.270282+0000","last_peered":"2024-09-15T22:57:54.270282+0000","last_clean":"2024-09-15T22:57:54.270282+0000","last_became_active":"2024-09-15T22:57:54.264322+0000","last_became_peered":"2024-09-15T22:57:54.264322+0000","last_unstale":"2024-09-15T22:57:54.270282+0000","last_undegraded":"2024-09-15T22:57:54.270282+0000","last_fullsized":"2024-09-15T22:57:54.270282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:50.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.257347+0000","last_change":"2024-09-15T22:57:53.237559+0000","last_active":"2024-09-15T22:57:54.257347+0000","last_peered":"2024-09-15T22:57:54.257347+0000","last_clean":"2024-09-15T22:57:54.257347+0000","last_became_active":"2024-09-15T22:57:53.236248+0000","last_became_peered":"2024-09-15T22:57:53.236248+0000","last_unstale":"2024-09-15T22:57:54.257347+0000","last_undegraded":"2024-09-15T22:57:54.257347+0000","last_fullsized":"2024-09-15T22:57:54.257347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:16.980162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.265051+0000","last_change":"2024-09-15T22:57:54.261472+0000","last_active":"2024-09-15T22:57:54.265051+0000","last_peered":"2024-09-15T22:57:54.265051+0000","last_clean":"2024-09-15T22:57:54.265051+0000","last_became_active":"2024-09-15T22:57:54.261187+0000","last_became_peered":"2024-09-15T22:57:54.261187+0000","last_unstale":"2024-09-15T22:57:54.265051+0000","last_undegraded":"2024-09-15T22:57:54.265051+0000","last_fullsized":"2024-09-15T22:57:54.265051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:08.367100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238774+0000","last_change":"2024-09-15T22:57:53.236543+0000","last_active":"2024-09-15T22:57:54.238774+0000","last_peered":"2024-09-15T22:57:54.238774+0000","last_clean":"2024-09-15T22:57:54.238774+0000","last_became_active":"2024-09-15T22:57:53.235956+0000","last_became_peered":"2024-09-15T22:57:53.235956+0000","last_unstale":"2024-09-15T22:57:54.238774+0000","last_undegraded":"2024-09-15T22:57:54.238774+0000","last_fullsized":"2024-09-15T22:57:54.238774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.531587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263258+0000","last_change":"2024-09-15T22:57:54.255536+0000","last_active":"2024-09-15T22:57:54.263258+0000","last_peered":"2024-09-15T22:57:54.263258+0000","last_clean":"2024-09-15T22:57:54.263258+0000","last_became_active":"2024-09-15T22:57:54.255218+0000","last_became_peered":"2024-09-15T22:57:54.255218+0000","last_unstale":"2024-09-15T22:57:54.263258+0000","last_undegraded":"2024-09-15T22:57:54.263258+0000","last_fullsized":"2024-09-15T22:57:54.263258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.248451+0000","last_change":"2024-09-15T22:57:53.230621+0000","last_active":"2024-09-15T22:57:54.248451+0000","last_peered":"2024-09-15T22:57:54.248451+0000","last_clean":"2024-09-15T22:57:54.248451+0000","last_became_active":"2024-09-15T22:57:53.230263+0000","last_became_peered":"2024-09-15T22:57:53.230263+0000","last_unstale":"2024-09-15T22:57:54.248451+0000","last_undegraded":"2024-09-15T22:57:54.248451+0000","last_fullsized":"2024-09-15T22:57:54.248451+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:57.922586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.286055+0000","last_change":"2024-09-15T22:57:54.282224+0000","last_active":"2024-09-15T22:57:54.286055+0000","last_peered":"2024-09-15T22:57:54.286055+0000","last_clean":"2024-09-15T22:57:54.286055+0000","last_became_active":"2024-09-15T22:57:54.281595+0000","last_became_peered":"2024-09-15T22:57:54.281595+0000","last_unstale":"2024-09-15T22:57:54.286055+0000","last_undegraded":"2024-09-15T22:57:54.286055+0000","last_fullsized":"2024-09-15T22:57:54.286055+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:10.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.247073+0000","last_change":"2024-09-15T22:57:53.248361+0000","last_active":"2024-09-15T22:57:54.247073+0000","last_peered":"2024-09-15T22:57:54.247073+0000","last_clean":"2024-09-15T22:57:54.247073+0000","last_became_active":"2024-09-15T22:57:53.247606+0000","last_became_peered":"2024-09-15T22:57:53.247606+0000","last_unstale":"2024-09-15T22:57:54.247073+0000","last_undegraded":"2024-09-15T22:57:54.247073+0000","last_fullsized":"2024-09-15T22:57:54.247073+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:32.025453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270527+0000","last_change":"2024-09-15T22:57:54.264040+0000","last_active":"2024-09-15T22:57:54.270527+0000","last_peered":"2024-09-15T22:57:54.270527+0000","last_clean":"2024-09-15T22:57:54.270527+0000","last_became_active":"2024-09-15T22:57:54.263728+0000","last_became_peered":"2024-09-15T22:57:54.263728+0000","last_unstale":"2024-09-15T22:57:54.270527+0000","last_undegraded":"2024-09-15T22:57:54.270527+0000","last_fullsized":"2024-09-15T22:57:54.270527+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:04.272611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.251326+0000","last_change":"2024-09-15T22:57:53.218317+0000","last_active":"2024-09-15T22:57:54.251326+0000","last_peered":"2024-09-15T22:57:54.251326+0000","last_clean":"2024-09-15T22:57:54.251326+0000","last_became_active":"2024-09-15T22:57:53.217629+0000","last_became_peered":"2024-09-15T22:57:53.217629+0000","last_unstale":"2024-09-15T22:57:54.251326+0000","last_undegraded":"2024-09-15T22:57:54.251326+0000","last_fullsized":"2024-09-15T22:57:54.251326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:12.976585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.262707+0000","last_change":"2024-09-15T22:57:54.259977+0000","last_active":"2024-09-15T22:57:54.262707+0000","last_peered":"2024-09-15T22:57:54.262707+0000","last_clean":"2024-09-15T22:57:54.262707+0000","last_became_active":"2024-09-15T22:57:54.259666+0000","last_became_peered":"2024-09-15T22:57:54.259666+0000","last_unstale":"2024-09-15T22:57:54.262707+0000","last_undegraded":"2024-09-15T22:57:54.262707+0000","last_fullsized":"2024-09-15T22:57:54.262707+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:52.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.235038+0000","last_change":"2024-09-15T22:57:53.243647+0000","last_active":"2024-09-15T22:57:54.235038+0000","last_peered":"2024-09-15T22:57:54.235038+0000","last_clean":"2024-09-15T22:57:54.235038+0000","last_became_active":"2024-09-15T22:57:53.242824+0000","last_became_peered":"2024-09-15T22:57:53.242824+0000","last_unstale":"2024-09-15T22:57:54.235038+0000","last_undegraded":"2024-09-15T22:57:54.235038+0000","last_fullsized":"2024-09-15T22:57:54.235038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:06.139522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.272292+0000","last_change":"2024-09-15T22:57:54.243803+0000","last_active":"2024-09-15T22:57:54.272292+0000","last_peered":"2024-09-15T22:57:54.272292+0000","last_clean":"2024-09-15T22:57:54.272292+0000","last_became_active":"2024-09-15T22:57:54.242975+0000","last_became_peered":"2024-09-15T22:57:54.242975+0000","last_unstale":"2024-09-15T22:57:54.272292+0000","last_undegraded":"2024-09-15T22:57:54.272292+0000","last_fullsized":"2024-09-15T22:57:54.272292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:32.155695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254519+0000","last_change":"2024-09-15T22:57:53.238165+0000","last_active":"2024-09-15T22:57:54.254519+0000","last_peered":"2024-09-15T22:57:54.254519+0000","last_clean":"2024-09-15T22:57:54.254519+0000","last_became_active":"2024-09-15T22:57:53.237298+0000","last_became_peered":"2024-09-15T22:57:53.237298+0000","last_unstale":"2024-09-15T22:57:54.254519+0000","last_undegraded":"2024-09-15T22:57:54.254519+0000","last_fullsized":"2024-09-15T22:57:54.254519+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:00.443379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.250958+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:54.250958+0000","last_peered":"2024-09-15T22:57:54.250958+0000","last_clean":"2024-09-15T22:57:54.250958+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:54.250958+0000","last_undegraded":"2024-09-15T22:57:54.250958+0000","last_fullsized":"2024-09-15T22:57:54.250958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1134592,"data_stored":808318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":540672,"data_stored":218478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":217826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":520192,"data_stored":211051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":548864,"data_stored":219460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":544768,"data_stored":219438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":540672,"data_stored":217986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":808250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:58.267 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:57:58.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.428+0000 7f018dd5b640 1 Processor -- start 2024-09-15T22:57:58.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.428+0000 7f018dd5b640 1 -- start start 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f018dd5b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 0x7f018815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f018dd5b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01880b1dc0 0x7f01880b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f018dd5b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01880b55e0 con 0x7f01880cca90 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f018dd5b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f01880ce3b0 con 0x7f01880b1dc0 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f018dd5b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f018815c5f0 con 0x7f01880b5200 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01880b1dc0 0x7f01880b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f017ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f01880cca90 0x7f01880b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59340/0 (socket says 172.21.15.28:59340) 2024-09-15T22:57:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f017ffff640 1 -- 172.21.15.28:0/1304484850 learned_addr learned my addr 172.21.15.28:0/1304484850 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f01877fe640 1 --2- 172.21.15.28:0/1304484850 >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 0x7f018815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 -- 172.21.15.28:0/1304484850 >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 msgr2=0x7f018815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 --2- 172.21.15.28:0/1304484850 >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 0x7f018815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 -- 172.21.15.28:0/1304484850 >> v1:172.21.15.28:6789/0 conn(0x7f01880cca90 legacy=0x7f01880b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 -- 172.21.15.28:0/1304484850 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880b2710 con 0x7f01880b1dc0 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f01877fe640 1 --2- 172.21.15.28:0/1304484850 >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 0x7f018815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0186ffd640 1 -- 172.21.15.28:0/1304484850 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599734803 0 0) 0x7f01880b55e0 con 0x7f01880cca90 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0187fff640 1 --2- 172.21.15.28:0/1304484850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b1dc0 0x7f01880b21d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f018806f1a0 tx=0x7f018001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de13be3a4c2c546 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0186ffd640 1 -- 172.21.15.28:0/1304484850 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800b2070 con 0x7f01880b1dc0 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0186ffd640 1 -- 172.21.15.28:0/1304484850 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01800a5850 con 0x7f01880b1dc0 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.432+0000 7f0186ffd640 1 -- 172.21.15.28:0/1304484850 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800a5c20 con 0x7f01880b1dc0 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/1304484850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b1dc0 msgr2=0x7f01880b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- 172.21.15.28:0/1304484850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b1dc0 0x7f01880b21d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f018806f1a0 tx=0x7f018001c8a0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/1304484850 shutdown_connections 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- 172.21.15.28:0/1304484850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b1dc0 0x7f01880b21d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- 172.21.15.28:0/1304484850 >> v2:172.21.15.131:3300/0 conn(0x7f01880b5200 0x7f018815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/1304484850 >> 172.21.15.28:0/1304484850 conn(0x7f018806bcc0 msgr2=0x7f018806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/1304484850 shutdown_connections 2024-09-15T22:57:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/1304484850 wait complete. 2024-09-15T22:57:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 Processor -- start 2024-09-15T22:57:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- start start 2024-09-15T22:57:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 0x7f01880d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01880cca90 0x7f018815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f01880b3d40 con 0x7f01880b5200 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f01880cd8c0 con 0x7f01880cca90 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f01880b3ec0 con 0x7f01880b1dc0 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55900/0 (socket says 172.21.15.28:55900) 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 -- 172.21.15.28:0/3922886489 learned_addr learned my addr 172.21.15.28:0/3922886489 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f01877fe640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 0x7f01880d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 -- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 msgr2=0x7f01880d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 0x7f01880d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 -- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01880cca90 msgr2=0x7f018815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01880cca90 0x7f018815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 -- 172.21.15.28:0/3922886489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0188162860 con 0x7f01880b5200 2024-09-15T22:57:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f01877fe640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 0x7f01880d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f017ffff640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f017000c410 tx=0x7f017000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700074e0 con 0x7f01880b5200 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01700047f0 con 0x7f01880b5200 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0188162b40 con 0x7f01880b5200 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170007680 con 0x7f01880b5200 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0188163100 con 0x7f01880b5200 2024-09-15T22:57:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.436+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880b21d0 con 0x7f01880b5200 2024-09-15T22:57:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.440+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0170011070 con 0x7f01880b5200 2024-09-15T22:57:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.440+0000 7f0184ff9640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 0x7f0168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.440+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f0170085840 con 0x7f01880b5200 2024-09-15T22:57:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.440+0000 7f01877fe640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 0x7f0168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.440+0000 7f01877fe640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 0x7f0168069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0178008930 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.444+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0170056380 con 0x7f01880b5200 2024-09-15T22:57:58.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.596+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f018815c1a0 con 0x7f01680678c0 2024-09-15T22:57:58.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.604+0000 7f0184ff9640 1 -- 172.21.15.28:0/3922886489 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251893 (secure 0 0 0) 0x7f018815c1a0 con 0x7f01680678c0 2024-09-15T22:57:58.608 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:58.610 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 msgr2=0x7f0168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 0x7f0168069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0178008930 tx=0x7f0178008040 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 msgr2=0x7f018815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f017000c410 tx=0x7f017000c8d0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 shutdown_connections 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f01680678c0 0x7f0168069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01880cca90 0x7f018815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01880b5200 0x7f018815a220 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 --2- 172.21.15.28:0/3922886489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01880b1dc0 0x7f01880d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 >> 172.21.15.28:0/3922886489 conn(0x7f018806bcc0 msgr2=0x7f018806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 shutdown_connections 2024-09-15T22:57:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.608+0000 7f018dd5b640 1 -- 172.21.15.28:0/3922886489 wait complete. 2024-09-15T22:57:58.626 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-15T22:57:57.896374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5496832,"data_stored":2920807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.696444"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285911+0000","last_change":"2024-09-15T22:57:54.285363+0000","last_active":"2024-09-15T22:57:54.285911+0000","last_peered":"2024-09-15T22:57:54.285911+0000","last_clean":"2024-09-15T22:57:54.285911+0000","last_became_active":"2024-09-15T22:57:54.285025+0000","last_became_peered":"2024-09-15T22:57:54.285025+0000","last_unstale":"2024-09-15T22:57:54.285911+0000","last_undegraded":"2024-09-15T22:57:54.285911+0000","last_fullsized":"2024-09-15T22:57:54.285911+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:35.265611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291821+0000","last_change":"2024-09-15T22:57:54.289906+0000","last_active":"2024-09-15T22:57:54.291821+0000","last_peered":"2024-09-15T22:57:54.291821+0000","last_clean":"2024-09-15T22:57:54.291821+0000","last_became_active":"2024-09-15T22:57:54.289376+0000","last_became_peered":"2024-09-15T22:57:54.289376+0000","last_unstale":"2024-09-15T22:57:54.291821+0000","last_undegraded":"2024-09-15T22:57:54.291821+0000","last_fullsized":"2024-09-15T22:57:54.291821+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:40.958353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270559+0000","last_change":"2024-09-15T22:57:54.263948+0000","last_active":"2024-09-15T22:57:54.270559+0000","last_peered":"2024-09-15T22:57:54.270559+0000","last_clean":"2024-09-15T22:57:54.270559+0000","last_became_active":"2024-09-15T22:57:54.263629+0000","last_became_peered":"2024-09-15T22:57:54.263629+0000","last_unstale":"2024-09-15T22:57:54.270559+0000","last_undegraded":"2024-09-15T22:57:54.270559+0000","last_fullsized":"2024-09-15T22:57:54.270559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:19.297702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281800+0000","last_change":"2024-09-15T22:57:54.276900+0000","last_active":"2024-09-15T22:57:54.281800+0000","last_peered":"2024-09-15T22:57:54.281800+0000","last_clean":"2024-09-15T22:57:54.281800+0000","last_became_active":"2024-09-15T22:57:54.275903+0000","last_became_peered":"2024-09-15T22:57:54.275903+0000","last_unstale":"2024-09-15T22:57:54.281800+0000","last_undegraded":"2024-09-15T22:57:54.281800+0000","last_fullsized":"2024-09-15T22:57:54.281800+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:15.937215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263935+0000","last_change":"2024-09-15T22:57:54.255235+0000","last_active":"2024-09-15T22:57:54.263935+0000","last_peered":"2024-09-15T22:57:54.263935+0000","last_clean":"2024-09-15T22:57:54.263935+0000","last_became_active":"2024-09-15T22:57:54.254485+0000","last_became_peered":"2024-09-15T22:57:54.254485+0000","last_unstale":"2024-09-15T22:57:54.263935+0000","last_undegraded":"2024-09-15T22:57:54.263935+0000","last_fullsized":"2024-09-15T22:57:54.263935+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:50.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.269996+0000","last_change":"2024-09-15T22:57:54.263025+0000","last_active":"2024-09-15T22:57:54.269996+0000","last_peered":"2024-09-15T22:57:54.269996+0000","last_clean":"2024-09-15T22:57:54.269996+0000","last_became_active":"2024-09-15T22:57:54.261492+0000","last_became_peered":"2024-09-15T22:57:54.261492+0000","last_unstale":"2024-09-15T22:57:54.269996+0000","last_undegraded":"2024-09-15T22:57:54.269996+0000","last_fullsized":"2024-09-15T22:57:54.269996+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:46.541543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270582+0000","last_change":"2024-09-15T22:57:54.264707+0000","last_active":"2024-09-15T22:57:54.270582+0000","last_peered":"2024-09-15T22:57:54.270582+0000","last_clean":"2024-09-15T22:57:54.270582+0000","last_became_active":"2024-09-15T22:57:54.264428+0000","last_became_peered":"2024-09-15T22:57:54.264428+0000","last_unstale":"2024-09-15T22:57:54.270582+0000","last_undegraded":"2024-09-15T22:57:54.270582+0000","last_fullsized":"2024-09-15T22:57:54.270582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:05.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277484+0000","last_change":"2024-09-15T22:57:54.267011+0000","last_active":"2024-09-15T22:57:54.277484+0000","last_peered":"2024-09-15T22:57:54.277484+0000","last_clean":"2024-09-15T22:57:54.277484+0000","last_became_active":"2024-09-15T22:57:54.266339+0000","last_became_peered":"2024-09-15T22:57:54.266339+0000","last_unstale":"2024-09-15T22:57:54.277484+0000","last_undegraded":"2024-09-15T22:57:54.277484+0000","last_fullsized":"2024-09-15T22:57:54.277484+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:20.097398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275621+0000","last_change":"2024-09-15T22:57:54.272117+0000","last_active":"2024-09-15T22:57:54.275621+0000","last_peered":"2024-09-15T22:57:54.275621+0000","last_clean":"2024-09-15T22:57:54.275621+0000","last_became_active":"2024-09-15T22:57:54.271838+0000","last_became_peered":"2024-09-15T22:57:54.271838+0000","last_unstale":"2024-09-15T22:57:54.275621+0000","last_undegraded":"2024-09-15T22:57:54.275621+0000","last_fullsized":"2024-09-15T22:57:54.275621+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:36.154217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270227+0000","last_change":"2024-09-15T22:57:54.264035+0000","last_active":"2024-09-15T22:57:54.270227+0000","last_peered":"2024-09-15T22:57:54.270227+0000","last_clean":"2024-09-15T22:57:54.270227+0000","last_became_active":"2024-09-15T22:57:54.263378+0000","last_became_peered":"2024-09-15T22:57:54.263378+0000","last_unstale":"2024-09-15T22:57:54.270227+0000","last_undegraded":"2024-09-15T22:57:54.270227+0000","last_fullsized":"2024-09-15T22:57:54.270227+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:45.179672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.260813+0000","last_change":"2024-09-15T22:57:54.254193+0000","last_active":"2024-09-15T22:57:54.260813+0000","last_peered":"2024-09-15T22:57:54.260813+0000","last_clean":"2024-09-15T22:57:54.260813+0000","last_became_active":"2024-09-15T22:57:54.253614+0000","last_became_peered":"2024-09-15T22:57:54.253614+0000","last_unstale":"2024-09-15T22:57:54.260813+0000","last_undegraded":"2024-09-15T22:57:54.260813+0000","last_fullsized":"2024-09-15T22:57:54.260813+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:02.940578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279496+0000","last_change":"2024-09-15T22:57:54.278894+0000","last_active":"2024-09-15T22:57:54.279496+0000","last_peered":"2024-09-15T22:57:54.279496+0000","last_clean":"2024-09-15T22:57:54.279496+0000","last_became_active":"2024-09-15T22:57:54.278586+0000","last_became_peered":"2024-09-15T22:57:54.278586+0000","last_unstale":"2024-09-15T22:57:54.279496+0000","last_undegraded":"2024-09-15T22:57:54.279496+0000","last_fullsized":"2024-09-15T22:57:54.279496+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:12.079018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270267+0000","last_change":"2024-09-15T22:57:54.263366+0000","last_active":"2024-09-15T22:57:54.270267+0000","last_peered":"2024-09-15T22:57:54.270267+0000","last_clean":"2024-09-15T22:57:54.270267+0000","last_became_active":"2024-09-15T22:57:54.263049+0000","last_became_peered":"2024-09-15T22:57:54.263049+0000","last_unstale":"2024-09-15T22:57:54.270267+0000","last_undegraded":"2024-09-15T22:57:54.270267+0000","last_fullsized":"2024-09-15T22:57:54.270267+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:13.986541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270082+0000","last_change":"2024-09-15T22:57:54.258424+0000","last_active":"2024-09-15T22:57:54.270082+0000","last_peered":"2024-09-15T22:57:54.270082+0000","last_clean":"2024-09-15T22:57:54.270082+0000","last_became_active":"2024-09-15T22:57:54.258125+0000","last_became_peered":"2024-09-15T22:57:54.258125+0000","last_unstale":"2024-09-15T22:57:54.270082+0000","last_undegraded":"2024-09-15T22:57:54.270082+0000","last_fullsized":"2024-09-15T22:57:54.270082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:32.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285778+0000","last_change":"2024-09-15T22:57:54.283732+0000","last_active":"2024-09-15T22:57:54.285778+0000","last_peered":"2024-09-15T22:57:54.285778+0000","last_clean":"2024-09-15T22:57:54.285778+0000","last_became_active":"2024-09-15T22:57:54.283099+0000","last_became_peered":"2024-09-15T22:57:54.283099+0000","last_unstale":"2024-09-15T22:57:54.285778+0000","last_undegraded":"2024-09-15T22:57:54.285778+0000","last_fullsized":"2024-09-15T22:57:54.285778+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:52.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.271581+0000","last_change":"2024-09-15T22:57:54.267062+0000","last_active":"2024-09-15T22:57:54.271581+0000","last_peered":"2024-09-15T22:57:54.271581+0000","last_clean":"2024-09-15T22:57:54.271581+0000","last_became_active":"2024-09-15T22:57:54.266628+0000","last_became_peered":"2024-09-15T22:57:54.266628+0000","last_unstale":"2024-09-15T22:57:54.271581+0000","last_undegraded":"2024-09-15T22:57:54.271581+0000","last_fullsized":"2024-09-15T22:57:54.271581+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.276521+0000","last_change":"2024-09-15T22:57:54.275182+0000","last_active":"2024-09-15T22:57:54.276521+0000","last_peered":"2024-09-15T22:57:54.276521+0000","last_clean":"2024-09-15T22:57:54.276521+0000","last_became_active":"2024-09-15T22:57:54.274855+0000","last_became_peered":"2024-09-15T22:57:54.274855+0000","last_unstale":"2024-09-15T22:57:54.276521+0000","last_undegraded":"2024-09-15T22:57:54.276521+0000","last_fullsized":"2024-09-15T22:57:54.276521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:54.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291862+0000","last_change":"2024-09-15T22:57:54.289911+0000","last_active":"2024-09-15T22:57:54.291862+0000","last_peered":"2024-09-15T22:57:54.291862+0000","last_clean":"2024-09-15T22:57:54.291862+0000","last_became_active":"2024-09-15T22:57:54.289396+0000","last_became_peered":"2024-09-15T22:57:54.289396+0000","last_unstale":"2024-09-15T22:57:54.291862+0000","last_undegraded":"2024-09-15T22:57:54.291862+0000","last_fullsized":"2024-09-15T22:57:54.291862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:52.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.272340+0000","last_change":"2024-09-15T22:57:54.270860+0000","last_active":"2024-09-15T22:57:54.272340+0000","last_peered":"2024-09-15T22:57:54.272340+0000","last_clean":"2024-09-15T22:57:54.272340+0000","last_became_active":"2024-09-15T22:57:54.270365+0000","last_became_peered":"2024-09-15T22:57:54.270365+0000","last_unstale":"2024-09-15T22:57:54.272340+0000","last_undegraded":"2024-09-15T22:57:54.272340+0000","last_fullsized":"2024-09-15T22:57:54.272340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:10.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282302+0000","last_change":"2024-09-15T22:57:54.267493+0000","last_active":"2024-09-15T22:57:54.282302+0000","last_peered":"2024-09-15T22:57:54.282302+0000","last_clean":"2024-09-15T22:57:54.282302+0000","last_became_active":"2024-09-15T22:57:54.266602+0000","last_became_peered":"2024-09-15T22:57:54.266602+0000","last_unstale":"2024-09-15T22:57:54.282302+0000","last_undegraded":"2024-09-15T22:57:54.282302+0000","last_fullsized":"2024-09-15T22:57:54.282302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:52.612831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.280959+0000","last_change":"2024-09-15T22:57:54.250398+0000","last_active":"2024-09-15T22:57:54.280959+0000","last_peered":"2024-09-15T22:57:54.280959+0000","last_clean":"2024-09-15T22:57:54.280959+0000","last_became_active":"2024-09-15T22:57:54.249681+0000","last_became_peered":"2024-09-15T22:57:54.249681+0000","last_unstale":"2024-09-15T22:57:54.280959+0000","last_undegraded":"2024-09-15T22:57:54.280959+0000","last_fullsized":"2024-09-15T22:57:54.280959+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:36.193358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275601+0000","last_change":"2024-09-15T22:57:54.272308+0000","last_active":"2024-09-15T22:57:54.275601+0000","last_peered":"2024-09-15T22:57:54.275601+0000","last_clean":"2024-09-15T22:57:54.275601+0000","last_became_active":"2024-09-15T22:57:54.272026+0000","last_became_peered":"2024-09-15T22:57:54.272026+0000","last_unstale":"2024-09-15T22:57:54.275601+0000","last_undegraded":"2024-09-15T22:57:54.275601+0000","last_fullsized":"2024-09-15T22:57:54.275601+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:05.952258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.260638+0000","last_change":"2024-09-15T22:57:54.253761+0000","last_active":"2024-09-15T22:57:54.260638+0000","last_peered":"2024-09-15T22:57:54.260638+0000","last_clean":"2024-09-15T22:57:54.260638+0000","last_became_active":"2024-09-15T22:57:54.253462+0000","last_became_peered":"2024-09-15T22:57:54.253462+0000","last_unstale":"2024-09-15T22:57:54.260638+0000","last_undegraded":"2024-09-15T22:57:54.260638+0000","last_fullsized":"2024-09-15T22:57:54.260638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:23.156976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263817+0000","last_change":"2024-09-15T22:57:54.257030+0000","last_active":"2024-09-15T22:57:54.263817+0000","last_peered":"2024-09-15T22:57:54.263817+0000","last_clean":"2024-09-15T22:57:54.263817+0000","last_became_active":"2024-09-15T22:57:54.256656+0000","last_became_peered":"2024-09-15T22:57:54.256656+0000","last_unstale":"2024-09-15T22:57:54.263817+0000","last_undegraded":"2024-09-15T22:57:54.263817+0000","last_fullsized":"2024-09-15T22:57:54.263817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:35.265611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270885+0000","last_change":"2024-09-15T22:57:54.265795+0000","last_active":"2024-09-15T22:57:54.270885+0000","last_peered":"2024-09-15T22:57:54.270885+0000","last_clean":"2024-09-15T22:57:54.270885+0000","last_became_active":"2024-09-15T22:57:54.263651+0000","last_became_peered":"2024-09-15T22:57:54.263651+0000","last_unstale":"2024-09-15T22:57:54.270885+0000","last_undegraded":"2024-09-15T22:57:54.270885+0000","last_fullsized":"2024-09-15T22:57:54.270885+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:26.331963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.265329+0000","last_change":"2024-09-15T22:57:54.263310+0000","last_active":"2024-09-15T22:57:54.265329+0000","last_peered":"2024-09-15T22:57:54.265329+0000","last_clean":"2024-09-15T22:57:54.265329+0000","last_became_active":"2024-09-15T22:57:54.262926+0000","last_became_peered":"2024-09-15T22:57:54.262926+0000","last_unstale":"2024-09-15T22:57:54.265329+0000","last_undegraded":"2024-09-15T22:57:54.265329+0000","last_fullsized":"2024-09-15T22:57:54.265329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:42.810706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.271585+0000","last_change":"2024-09-15T22:57:54.267313+0000","last_active":"2024-09-15T22:57:54.271585+0000","last_peered":"2024-09-15T22:57:54.271585+0000","last_clean":"2024-09-15T22:57:54.271585+0000","last_became_active":"2024-09-15T22:57:54.266473+0000","last_became_peered":"2024-09-15T22:57:54.266473+0000","last_unstale":"2024-09-15T22:57:54.271585+0000","last_undegraded":"2024-09-15T22:57:54.271585+0000","last_fullsized":"2024-09-15T22:57:54.271585+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281075+0000","last_change":"2024-09-15T22:57:54.251582+0000","last_active":"2024-09-15T22:57:54.281075+0000","last_peered":"2024-09-15T22:57:54.281075+0000","last_clean":"2024-09-15T22:57:54.281075+0000","last_became_active":"2024-09-15T22:57:54.250807+0000","last_became_peered":"2024-09-15T22:57:54.250807+0000","last_unstale":"2024-09-15T22:57:54.281075+0000","last_undegraded":"2024-09-15T22:57:54.281075+0000","last_fullsized":"2024-09-15T22:57:54.281075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:41.920408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285329+0000","last_change":"2024-09-15T22:57:54.284373+0000","last_active":"2024-09-15T22:57:54.285329+0000","last_peered":"2024-09-15T22:57:54.285329+0000","last_clean":"2024-09-15T22:57:54.285329+0000","last_became_active":"2024-09-15T22:57:54.284049+0000","last_became_peered":"2024-09-15T22:57:54.284049+0000","last_unstale":"2024-09-15T22:57:54.285329+0000","last_undegraded":"2024-09-15T22:57:54.285329+0000","last_fullsized":"2024-09-15T22:57:54.285329+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:04.072882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282833+0000","last_change":"2024-09-15T22:57:54.278384+0000","last_active":"2024-09-15T22:57:54.282833+0000","last_peered":"2024-09-15T22:57:54.282833+0000","last_clean":"2024-09-15T22:57:54.282833+0000","last_became_active":"2024-09-15T22:57:54.276018+0000","last_became_peered":"2024-09-15T22:57:54.276018+0000","last_unstale":"2024-09-15T22:57:54.282833+0000","last_undegraded":"2024-09-15T22:57:54.282833+0000","last_fullsized":"2024-09-15T22:57:54.282833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:33.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270552+0000","last_change":"2024-09-15T22:57:54.264143+0000","last_active":"2024-09-15T22:57:54.270552+0000","last_peered":"2024-09-15T22:57:54.270552+0000","last_clean":"2024-09-15T22:57:54.270552+0000","last_became_active":"2024-09-15T22:57:54.263827+0000","last_became_peered":"2024-09-15T22:57:54.263827+0000","last_unstale":"2024-09-15T22:57:54.270552+0000","last_undegraded":"2024-09-15T22:57:54.270552+0000","last_fullsized":"2024-09-15T22:57:54.270552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:46.744117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278485+0000","last_change":"2024-09-15T22:57:54.261405+0000","last_active":"2024-09-15T22:57:54.278485+0000","last_peered":"2024-09-15T22:57:54.278485+0000","last_clean":"2024-09-15T22:57:54.278485+0000","last_became_active":"2024-09-15T22:57:54.257134+0000","last_became_peered":"2024-09-15T22:57:54.257134+0000","last_unstale":"2024-09-15T22:57:54.278485+0000","last_undegraded":"2024-09-15T22:57:54.278485+0000","last_fullsized":"2024-09-15T22:57:54.278485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:04.272611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.291698+0000","last_change":"2024-09-15T22:57:54.287654+0000","last_active":"2024-09-15T22:57:54.291698+0000","last_peered":"2024-09-15T22:57:54.291698+0000","last_clean":"2024-09-15T22:57:54.291698+0000","last_became_active":"2024-09-15T22:57:54.287152+0000","last_became_peered":"2024-09-15T22:57:54.287152+0000","last_unstale":"2024-09-15T22:57:54.291698+0000","last_undegraded":"2024-09-15T22:57:54.291698+0000","last_fullsized":"2024-09-15T22:57:54.291698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.463302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"45'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.283001+0000","last_change":"2024-09-15T22:57:53.230201+0000","last_active":"2024-09-15T22:57:54.283001+0000","last_peered":"2024-09-15T22:57:54.283001+0000","last_clean":"2024-09-15T22:57:54.283001+0000","last_became_active":"2024-09-15T22:57:53.229476+0000","last_became_peered":"2024-09-15T22:57:53.229476+0000","last_unstale":"2024-09-15T22:57:54.283001+0000","last_undegraded":"2024-09-15T22:57:54.283001+0000","last_fullsized":"2024-09-15T22:57:54.283001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:38.538087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278879+0000","last_change":"2024-09-15T22:57:54.275511+0000","last_active":"2024-09-15T22:57:54.278879+0000","last_peered":"2024-09-15T22:57:54.278879+0000","last_clean":"2024-09-15T22:57:54.278879+0000","last_became_active":"2024-09-15T22:57:54.274845+0000","last_became_peered":"2024-09-15T22:57:54.274845+0000","last_unstale":"2024-09-15T22:57:54.278879+0000","last_undegraded":"2024-09-15T22:57:54.278879+0000","last_fullsized":"2024-09-15T22:57:54.278879+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:05.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.274694+0000","last_change":"2024-09-15T22:57:53.245726+0000","last_active":"2024-09-15T22:57:54.274694+0000","last_peered":"2024-09-15T22:57:54.274694+0000","last_clean":"2024-09-15T22:57:54.274694+0000","last_became_active":"2024-09-15T22:57:53.244009+0000","last_became_peered":"2024-09-15T22:57:53.244009+0000","last_unstale":"2024-09-15T22:57:54.274694+0000","last_undegraded":"2024-09-15T22:57:54.274694+0000","last_fullsized":"2024-09-15T22:57:54.274694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:42.788745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.281718+0000","last_change":"2024-09-15T22:57:54.254040+0000","last_active":"2024-09-15T22:57:54.281718+0000","last_peered":"2024-09-15T22:57:54.281718+0000","last_clean":"2024-09-15T22:57:54.281718+0000","last_became_active":"2024-09-15T22:57:54.253224+0000","last_became_peered":"2024-09-15T22:57:54.253224+0000","last_unstale":"2024-09-15T22:57:54.281718+0000","last_undegraded":"2024-09-15T22:57:54.281718+0000","last_fullsized":"2024-09-15T22:57:54.281718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:14:28.625926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.284955+0000","last_change":"2024-09-15T22:57:53.236601+0000","last_active":"2024-09-15T22:57:54.284955+0000","last_peered":"2024-09-15T22:57:54.284955+0000","last_clean":"2024-09-15T22:57:54.284955+0000","last_became_active":"2024-09-15T22:57:53.235946+0000","last_became_peered":"2024-09-15T22:57:53.235946+0000","last_unstale":"2024-09-15T22:57:54.284955+0000","last_undegraded":"2024-09-15T22:57:54.284955+0000","last_fullsized":"2024-09-15T22:57:54.284955+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:01.134725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268888+0000","last_change":"2024-09-15T22:57:54.266179+0000","last_active":"2024-09-15T22:57:54.268888+0000","last_peered":"2024-09-15T22:57:54.268888+0000","last_clean":"2024-09-15T22:57:54.268888+0000","last_became_active":"2024-09-15T22:57:54.265839+0000","last_became_peered":"2024-09-15T22:57:54.265839+0000","last_unstale":"2024-09-15T22:57:54.268888+0000","last_undegraded":"2024-09-15T22:57:54.268888+0000","last_fullsized":"2024-09-15T22:57:54.268888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:45.163769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277482+0000","last_change":"2024-09-15T22:57:53.229462+0000","last_active":"2024-09-15T22:57:54.277482+0000","last_peered":"2024-09-15T22:57:54.277482+0000","last_clean":"2024-09-15T22:57:54.277482+0000","last_became_active":"2024-09-15T22:57:53.228775+0000","last_became_peered":"2024-09-15T22:57:53.228775+0000","last_unstale":"2024-09-15T22:57:54.277482+0000","last_undegraded":"2024-09-15T22:57:54.277482+0000","last_fullsized":"2024-09-15T22:57:54.277482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:34.255656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270777+0000","last_change":"2024-09-15T22:57:54.266824+0000","last_active":"2024-09-15T22:57:54.270777+0000","last_peered":"2024-09-15T22:57:54.270777+0000","last_clean":"2024-09-15T22:57:54.270777+0000","last_became_active":"2024-09-15T22:57:54.266123+0000","last_became_peered":"2024-09-15T22:57:54.266123+0000","last_unstale":"2024-09-15T22:57:54.270777+0000","last_undegraded":"2024-09-15T22:57:54.270777+0000","last_fullsized":"2024-09-15T22:57:54.270777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268512+0000","last_change":"2024-09-15T22:57:53.238086+0000","last_active":"2024-09-15T22:57:54.268512+0000","last_peered":"2024-09-15T22:57:54.268512+0000","last_clean":"2024-09-15T22:57:54.268512+0000","last_became_active":"2024-09-15T22:57:53.237241+0000","last_became_peered":"2024-09-15T22:57:53.237241+0000","last_unstale":"2024-09-15T22:57:54.268512+0000","last_undegraded":"2024-09-15T22:57:54.268512+0000","last_fullsized":"2024-09-15T22:57:54.268512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:44.169717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282763+0000","last_change":"2024-09-15T22:57:54.277739+0000","last_active":"2024-09-15T22:57:54.282763+0000","last_peered":"2024-09-15T22:57:54.282763+0000","last_clean":"2024-09-15T22:57:54.282763+0000","last_became_active":"2024-09-15T22:57:54.277175+0000","last_became_peered":"2024-09-15T22:57:54.277175+0000","last_unstale":"2024-09-15T22:57:54.282763+0000","last_undegraded":"2024-09-15T22:57:54.282763+0000","last_fullsized":"2024-09-15T22:57:54.282763+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:04.072882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.283634+0000","last_change":"2024-09-15T22:57:53.229464+0000","last_active":"2024-09-15T22:57:54.283634+0000","last_peered":"2024-09-15T22:57:54.283634+0000","last_clean":"2024-09-15T22:57:54.283634+0000","last_became_active":"2024-09-15T22:57:53.228724+0000","last_became_peered":"2024-09-15T22:57:53.228724+0000","last_unstale":"2024-09-15T22:57:54.283634+0000","last_undegraded":"2024-09-15T22:57:54.283634+0000","last_fullsized":"2024-09-15T22:57:54.283634+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.531587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263167+0000","last_change":"2024-09-15T22:57:54.260008+0000","last_active":"2024-09-15T22:57:54.263167+0000","last_peered":"2024-09-15T22:57:54.263167+0000","last_clean":"2024-09-15T22:57:54.263167+0000","last_became_active":"2024-09-15T22:57:54.259709+0000","last_became_peered":"2024-09-15T22:57:54.259709+0000","last_unstale":"2024-09-15T22:57:54.263167+0000","last_undegraded":"2024-09-15T22:57:54.263167+0000","last_fullsized":"2024-09-15T22:57:54.263167+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:36.217120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.234799+0000","last_change":"2024-09-15T22:57:53.238192+0000","last_active":"2024-09-15T22:57:54.234799+0000","last_peered":"2024-09-15T22:57:54.234799+0000","last_clean":"2024-09-15T22:57:54.234799+0000","last_became_active":"2024-09-15T22:57:53.237470+0000","last_became_peered":"2024-09-15T22:57:53.237470+0000","last_unstale":"2024-09-15T22:57:54.234799+0000","last_undegraded":"2024-09-15T22:57:54.234799+0000","last_fullsized":"2024-09-15T22:57:54.234799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:06:57.937279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282825+0000","last_change":"2024-09-15T22:57:54.279091+0000","last_active":"2024-09-15T22:57:54.282825+0000","last_peered":"2024-09-15T22:57:54.282825+0000","last_clean":"2024-09-15T22:57:54.282825+0000","last_became_active":"2024-09-15T22:57:54.278407+0000","last_became_peered":"2024-09-15T22:57:54.278407+0000","last_unstale":"2024-09-15T22:57:54.282825+0000","last_undegraded":"2024-09-15T22:57:54.282825+0000","last_fullsized":"2024-09-15T22:57:54.282825+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:58.932541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238633+0000","last_change":"2024-09-15T22:57:53.237831+0000","last_active":"2024-09-15T22:57:54.238633+0000","last_peered":"2024-09-15T22:57:54.238633+0000","last_clean":"2024-09-15T22:57:54.238633+0000","last_became_active":"2024-09-15T22:57:53.237164+0000","last_became_peered":"2024-09-15T22:57:53.237164+0000","last_unstale":"2024-09-15T22:57:54.238633+0000","last_undegraded":"2024-09-15T22:57:54.238633+0000","last_fullsized":"2024-09-15T22:57:54.238633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:03.918355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.273479+0000","last_change":"2024-09-15T22:57:54.265174+0000","last_active":"2024-09-15T22:57:54.273479+0000","last_peered":"2024-09-15T22:57:54.273479+0000","last_clean":"2024-09-15T22:57:54.273479+0000","last_became_active":"2024-09-15T22:57:54.262152+0000","last_became_peered":"2024-09-15T22:57:54.262152+0000","last_unstale":"2024-09-15T22:57:54.273479+0000","last_undegraded":"2024-09-15T22:57:54.273479+0000","last_fullsized":"2024-09-15T22:57:54.273479+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:15.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.259300+0000","last_change":"2024-09-15T22:57:53.237254+0000","last_active":"2024-09-15T22:57:54.259300+0000","last_peered":"2024-09-15T22:57:54.259300+0000","last_clean":"2024-09-15T22:57:54.259300+0000","last_became_active":"2024-09-15T22:57:53.236384+0000","last_became_peered":"2024-09-15T22:57:53.236384+0000","last_unstale":"2024-09-15T22:57:54.259300+0000","last_undegraded":"2024-09-15T22:57:54.259300+0000","last_fullsized":"2024-09-15T22:57:54.259300+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:53.067810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.258051+0000","last_change":"2024-09-15T22:57:54.248081+0000","last_active":"2024-09-15T22:57:54.258051+0000","last_peered":"2024-09-15T22:57:54.258051+0000","last_clean":"2024-09-15T22:57:54.258051+0000","last_became_active":"2024-09-15T22:57:54.247384+0000","last_became_peered":"2024-09-15T22:57:54.247384+0000","last_unstale":"2024-09-15T22:57:54.258051+0000","last_undegraded":"2024-09-15T22:57:54.258051+0000","last_fullsized":"2024-09-15T22:57:54.258051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:32.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254000+0000","last_change":"2024-09-15T22:57:53.243239+0000","last_active":"2024-09-15T22:57:54.254000+0000","last_peered":"2024-09-15T22:57:54.254000+0000","last_clean":"2024-09-15T22:57:54.254000+0000","last_became_active":"2024-09-15T22:57:53.242559+0000","last_became_peered":"2024-09-15T22:57:53.242559+0000","last_unstale":"2024-09-15T22:57:54.254000+0000","last_undegraded":"2024-09-15T22:57:54.254000+0000","last_fullsized":"2024-09-15T22:57:54.254000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:44.169717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.275486+0000","last_change":"2024-09-15T22:57:54.274182+0000","last_active":"2024-09-15T22:57:54.275486+0000","last_peered":"2024-09-15T22:57:54.275486+0000","last_clean":"2024-09-15T22:57:54.275486+0000","last_became_active":"2024-09-15T22:57:54.273899+0000","last_became_peered":"2024-09-15T22:57:54.273899+0000","last_unstale":"2024-09-15T22:57:54.275486+0000","last_undegraded":"2024-09-15T22:57:54.275486+0000","last_fullsized":"2024-09-15T22:57:54.275486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:17.990117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"45'3","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279907+0000","last_change":"2024-09-15T22:57:53.239653+0000","last_active":"2024-09-15T22:57:54.279907+0000","last_peered":"2024-09-15T22:57:54.279907+0000","last_clean":"2024-09-15T22:57:54.279907+0000","last_became_active":"2024-09-15T22:57:53.238395+0000","last_became_peered":"2024-09-15T22:57:53.238395+0000","last_unstale":"2024-09-15T22:57:54.279907+0000","last_undegraded":"2024-09-15T22:57:54.279907+0000","last_fullsized":"2024-09-15T22:57:54.279907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:09.178058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.268132+0000","last_change":"2024-09-15T22:57:54.263125+0000","last_active":"2024-09-15T22:57:54.268132+0000","last_peered":"2024-09-15T22:57:54.268132+0000","last_clean":"2024-09-15T22:57:54.268132+0000","last_became_active":"2024-09-15T22:57:54.262040+0000","last_became_peered":"2024-09-15T22:57:54.262040+0000","last_unstale":"2024-09-15T22:57:54.268132+0000","last_undegraded":"2024-09-15T22:57:54.268132+0000","last_fullsized":"2024-09-15T22:57:54.268132+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:01.453335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"45'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277994+0000","last_change":"2024-09-15T22:57:53.230234+0000","last_active":"2024-09-15T22:57:54.277994+0000","last_peered":"2024-09-15T22:57:54.277994+0000","last_clean":"2024-09-15T22:57:54.277994+0000","last_became_active":"2024-09-15T22:57:53.229849+0000","last_became_peered":"2024-09-15T22:57:53.229849+0000","last_unstale":"2024-09-15T22:57:54.277994+0000","last_undegraded":"2024-09-15T22:57:54.277994+0000","last_fullsized":"2024-09-15T22:57:54.277994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:51.785303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285692+0000","last_change":"2024-09-15T22:57:54.281318+0000","last_active":"2024-09-15T22:57:54.285692+0000","last_peered":"2024-09-15T22:57:54.285692+0000","last_clean":"2024-09-15T22:57:54.285692+0000","last_became_active":"2024-09-15T22:57:54.280664+0000","last_became_peered":"2024-09-15T22:57:54.280664+0000","last_unstale":"2024-09-15T22:57:54.285692+0000","last_undegraded":"2024-09-15T22:57:54.285692+0000","last_fullsized":"2024-09-15T22:57:54.285692+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:26.331963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282019+0000","last_change":"2024-09-15T22:57:53.235098+0000","last_active":"2024-09-15T22:57:54.282019+0000","last_peered":"2024-09-15T22:57:54.282019+0000","last_clean":"2024-09-15T22:57:54.282019+0000","last_became_active":"2024-09-15T22:57:53.234635+0000","last_became_peered":"2024-09-15T22:57:53.234635+0000","last_unstale":"2024-09-15T22:57:54.282019+0000","last_undegraded":"2024-09-15T22:57:54.282019+0000","last_fullsized":"2024-09-15T22:57:54.282019+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:49.499626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.261776+0000","last_change":"2024-09-15T22:57:54.254981+0000","last_active":"2024-09-15T22:57:54.261776+0000","last_peered":"2024-09-15T22:57:54.261776+0000","last_clean":"2024-09-15T22:57:54.261776+0000","last_became_active":"2024-09-15T22:57:54.254684+0000","last_became_peered":"2024-09-15T22:57:54.254684+0000","last_unstale":"2024-09-15T22:57:54.261776+0000","last_undegraded":"2024-09-15T22:57:54.261776+0000","last_fullsized":"2024-09-15T22:57:54.261776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:00.252147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.233252+0000","last_change":"2024-09-15T22:57:53.244788+0000","last_active":"2024-09-15T22:57:54.233252+0000","last_peered":"2024-09-15T22:57:54.233252+0000","last_clean":"2024-09-15T22:57:54.233252+0000","last_became_active":"2024-09-15T22:57:53.243954+0000","last_became_peered":"2024-09-15T22:57:53.243954+0000","last_unstale":"2024-09-15T22:57:54.233252+0000","last_undegraded":"2024-09-15T22:57:54.233252+0000","last_fullsized":"2024-09-15T22:57:54.233252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:15.631993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254711+0000","last_change":"2024-09-15T22:57:54.249573+0000","last_active":"2024-09-15T22:57:54.254711+0000","last_peered":"2024-09-15T22:57:54.254711+0000","last_clean":"2024-09-15T22:57:54.254711+0000","last_became_active":"2024-09-15T22:57:54.249068+0000","last_became_peered":"2024-09-15T22:57:54.249068+0000","last_unstale":"2024-09-15T22:57:54.254711+0000","last_undegraded":"2024-09-15T22:57:54.254711+0000","last_fullsized":"2024-09-15T22:57:54.254711+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:08.463302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.252604+0000","last_change":"2024-09-15T22:57:53.235162+0000","last_active":"2024-09-15T22:57:54.252604+0000","last_peered":"2024-09-15T22:57:54.252604+0000","last_clean":"2024-09-15T22:57:54.252604+0000","last_became_active":"2024-09-15T22:57:53.234238+0000","last_became_peered":"2024-09-15T22:57:53.234238+0000","last_unstale":"2024-09-15T22:57:54.252604+0000","last_undegraded":"2024-09-15T22:57:54.252604+0000","last_fullsized":"2024-09-15T22:57:54.252604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:25.322008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277065+0000","last_change":"2024-09-15T22:57:54.276592+0000","last_active":"2024-09-15T22:57:54.277065+0000","last_peered":"2024-09-15T22:57:54.277065+0000","last_clean":"2024-09-15T22:57:54.277065+0000","last_became_active":"2024-09-15T22:57:54.276247+0000","last_became_peered":"2024-09-15T22:57:54.276247+0000","last_unstale":"2024-09-15T22:57:54.277065+0000","last_undegraded":"2024-09-15T22:57:54.277065+0000","last_fullsized":"2024-09-15T22:57:54.277065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:15.937215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"45'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.278163+0000","last_change":"2024-09-15T22:57:53.241159+0000","last_active":"2024-09-15T22:57:54.278163+0000","last_peered":"2024-09-15T22:57:54.278163+0000","last_clean":"2024-09-15T22:57:54.278163+0000","last_became_active":"2024-09-15T22:57:53.240701+0000","last_became_peered":"2024-09-15T22:57:53.240701+0000","last_unstale":"2024-09-15T22:57:54.278163+0000","last_undegraded":"2024-09-15T22:57:54.278163+0000","last_fullsized":"2024-09-15T22:57:54.278163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:03.062927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254753+0000","last_change":"2024-09-15T22:57:54.250567+0000","last_active":"2024-09-15T22:57:54.254753+0000","last_peered":"2024-09-15T22:57:54.254753+0000","last_clean":"2024-09-15T22:57:54.254753+0000","last_became_active":"2024-09-15T22:57:54.250069+0000","last_became_peered":"2024-09-15T22:57:54.250069+0000","last_unstale":"2024-09-15T22:57:54.254753+0000","last_undegraded":"2024-09-15T22:57:54.254753+0000","last_fullsized":"2024-09-15T22:57:54.254753+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:40.958353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.273696+0000","last_change":"2024-09-15T22:57:53.234036+0000","last_active":"2024-09-15T22:57:54.273696+0000","last_peered":"2024-09-15T22:57:54.273696+0000","last_clean":"2024-09-15T22:57:54.273696+0000","last_became_active":"2024-09-15T22:57:53.228729+0000","last_became_peered":"2024-09-15T22:57:53.228729+0000","last_unstale":"2024-09-15T22:57:54.273696+0000","last_undegraded":"2024-09-15T22:57:54.273696+0000","last_fullsized":"2024-09-15T22:57:54.273696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:14.128641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270185+0000","last_change":"2024-09-15T22:57:54.266030+0000","last_active":"2024-09-15T22:57:54.270185+0000","last_peered":"2024-09-15T22:57:54.270185+0000","last_clean":"2024-09-15T22:57:54.270185+0000","last_became_active":"2024-09-15T22:57:54.265722+0000","last_became_peered":"2024-09-15T22:57:54.265722+0000","last_unstale":"2024-09-15T22:57:54.270185+0000","last_undegraded":"2024-09-15T22:57:54.270185+0000","last_fullsized":"2024-09-15T22:57:54.270185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:15.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.290836+0000","last_change":"2024-09-15T22:57:53.236609+0000","last_active":"2024-09-15T22:57:54.290836+0000","last_peered":"2024-09-15T22:57:54.290836+0000","last_clean":"2024-09-15T22:57:54.290836+0000","last_became_active":"2024-09-15T22:57:53.236196+0000","last_became_peered":"2024-09-15T22:57:53.236196+0000","last_unstale":"2024-09-15T22:57:54.290836+0000","last_undegraded":"2024-09-15T22:57:54.290836+0000","last_fullsized":"2024-09-15T22:57:54.290836+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:39.654871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.279806+0000","last_change":"2024-09-15T22:57:54.276327+0000","last_active":"2024-09-15T22:57:54.279806+0000","last_peered":"2024-09-15T22:57:54.279806+0000","last_clean":"2024-09-15T22:57:54.279806+0000","last_became_active":"2024-09-15T22:57:54.275609+0000","last_became_peered":"2024-09-15T22:57:54.275609+0000","last_unstale":"2024-09-15T22:57:54.279806+0000","last_undegraded":"2024-09-15T22:57:54.279806+0000","last_fullsized":"2024-09-15T22:57:54.279806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282085+0000","last_change":"2024-09-15T22:57:53.232328+0000","last_active":"2024-09-15T22:57:54.282085+0000","last_peered":"2024-09-15T22:57:54.282085+0000","last_clean":"2024-09-15T22:57:54.282085+0000","last_became_active":"2024-09-15T22:57:53.231472+0000","last_became_peered":"2024-09-15T22:57:53.231472+0000","last_unstale":"2024-09-15T22:57:54.282085+0000","last_undegraded":"2024-09-15T22:57:54.282085+0000","last_fullsized":"2024-09-15T22:57:54.282085+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:19.933878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.250266+0000","last_change":"2024-09-15T22:57:54.247880+0000","last_active":"2024-09-15T22:57:54.250266+0000","last_peered":"2024-09-15T22:57:54.250266+0000","last_clean":"2024-09-15T22:57:54.250266+0000","last_became_active":"2024-09-15T22:57:54.247570+0000","last_became_peered":"2024-09-15T22:57:54.247570+0000","last_unstale":"2024-09-15T22:57:54.250266+0000","last_undegraded":"2024-09-15T22:57:54.250266+0000","last_fullsized":"2024-09-15T22:57:54.250266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:04.928310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.232810+0000","last_change":"2024-09-15T22:57:53.242670+0000","last_active":"2024-09-15T22:57:54.232810+0000","last_peered":"2024-09-15T22:57:54.232810+0000","last_clean":"2024-09-15T22:57:54.232810+0000","last_became_active":"2024-09-15T22:57:53.241739+0000","last_became_peered":"2024-09-15T22:57:53.241739+0000","last_unstale":"2024-09-15T22:57:54.232810+0000","last_undegraded":"2024-09-15T22:57:54.232810+0000","last_fullsized":"2024-09-15T22:57:54.232810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:14.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.277293+0000","last_change":"2024-09-15T22:57:54.271394+0000","last_active":"2024-09-15T22:57:54.277293+0000","last_peered":"2024-09-15T22:57:54.277293+0000","last_clean":"2024-09-15T22:57:54.277293+0000","last_became_active":"2024-09-15T22:57:54.270688+0000","last_became_peered":"2024-09-15T22:57:54.270688+0000","last_unstale":"2024-09-15T22:57:54.277293+0000","last_undegraded":"2024-09-15T22:57:54.277293+0000","last_fullsized":"2024-09-15T22:57:54.277293+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:46.744117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.292862+0000","last_change":"2024-09-15T22:57:53.240336+0000","last_active":"2024-09-15T22:57:54.292862+0000","last_peered":"2024-09-15T22:57:54.292862+0000","last_clean":"2024-09-15T22:57:54.292862+0000","last_became_active":"2024-09-15T22:57:53.238390+0000","last_became_peered":"2024-09-15T22:57:53.238390+0000","last_unstale":"2024-09-15T22:57:54.292862+0000","last_undegraded":"2024-09-15T22:57:54.292862+0000","last_fullsized":"2024-09-15T22:57:54.292862+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:19.596823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282206+0000","last_change":"2024-09-15T22:57:54.264219+0000","last_active":"2024-09-15T22:57:54.282206+0000","last_peered":"2024-09-15T22:57:54.282206+0000","last_clean":"2024-09-15T22:57:54.282206+0000","last_became_active":"2024-09-15T22:57:54.263480+0000","last_became_peered":"2024-09-15T22:57:54.263480+0000","last_unstale":"2024-09-15T22:57:54.282206+0000","last_undegraded":"2024-09-15T22:57:54.282206+0000","last_fullsized":"2024-09-15T22:57:54.282206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:35.223864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238360+0000","last_change":"2024-09-15T22:57:53.236601+0000","last_active":"2024-09-15T22:57:54.238360+0000","last_peered":"2024-09-15T22:57:54.238360+0000","last_clean":"2024-09-15T22:57:54.238360+0000","last_became_active":"2024-09-15T22:57:53.235945+0000","last_became_peered":"2024-09-15T22:57:53.235945+0000","last_unstale":"2024-09-15T22:57:54.238360+0000","last_undegraded":"2024-09-15T22:57:54.238360+0000","last_fullsized":"2024-09-15T22:57:54.238360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:14.927260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.285333+0000","last_change":"2024-09-15T22:57:54.284446+0000","last_active":"2024-09-15T22:57:54.285333+0000","last_peered":"2024-09-15T22:57:54.285333+0000","last_clean":"2024-09-15T22:57:54.285333+0000","last_became_active":"2024-09-15T22:57:54.284097+0000","last_became_peered":"2024-09-15T22:57:54.284097+0000","last_unstale":"2024-09-15T22:57:54.285333+0000","last_undegraded":"2024-09-15T22:57:54.285333+0000","last_fullsized":"2024-09-15T22:57:54.285333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:33.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.253020+0000","last_change":"2024-09-15T22:57:53.234169+0000","last_active":"2024-09-15T22:57:54.253020+0000","last_peered":"2024-09-15T22:57:54.253020+0000","last_clean":"2024-09-15T22:57:54.253020+0000","last_became_active":"2024-09-15T22:57:53.233781+0000","last_became_peered":"2024-09-15T22:57:53.233781+0000","last_unstale":"2024-09-15T22:57:54.253020+0000","last_undegraded":"2024-09-15T22:57:54.253020+0000","last_fullsized":"2024-09-15T22:57:54.253020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:12.976585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270162+0000","last_change":"2024-09-15T22:57:54.264812+0000","last_active":"2024-09-15T22:57:54.270162+0000","last_peered":"2024-09-15T22:57:54.270162+0000","last_clean":"2024-09-15T22:57:54.270162+0000","last_became_active":"2024-09-15T22:57:54.261560+0000","last_became_peered":"2024-09-15T22:57:54.261560+0000","last_unstale":"2024-09-15T22:57:54.270162+0000","last_undegraded":"2024-09-15T22:57:54.270162+0000","last_fullsized":"2024-09-15T22:57:54.270162+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:01.453335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.230854+0000","last_change":"2024-09-15T22:57:53.213417+0000","last_active":"2024-09-15T22:57:54.230854+0000","last_peered":"2024-09-15T22:57:54.230854+0000","last_clean":"2024-09-15T22:57:54.230854+0000","last_became_active":"2024-09-15T22:57:53.213004+0000","last_became_peered":"2024-09-15T22:57:53.213004+0000","last_unstale":"2024-09-15T22:57:54.230854+0000","last_undegraded":"2024-09-15T22:57:54.230854+0000","last_fullsized":"2024-09-15T22:57:54.230854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:56.156115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.274254+0000","last_change":"2024-09-15T22:57:54.262051+0000","last_active":"2024-09-15T22:57:54.274254+0000","last_peered":"2024-09-15T22:57:54.274254+0000","last_clean":"2024-09-15T22:57:54.274254+0000","last_became_active":"2024-09-15T22:57:54.261322+0000","last_became_peered":"2024-09-15T22:57:54.261322+0000","last_unstale":"2024-09-15T22:57:54.274254+0000","last_undegraded":"2024-09-15T22:57:54.274254+0000","last_fullsized":"2024-09-15T22:57:54.274254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:19.297702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.282904+0000","last_change":"2024-09-15T22:57:53.242843+0000","last_active":"2024-09-15T22:57:54.282904+0000","last_peered":"2024-09-15T22:57:54.282904+0000","last_clean":"2024-09-15T22:57:54.282904+0000","last_became_active":"2024-09-15T22:57:53.242106+0000","last_became_peered":"2024-09-15T22:57:53.242106+0000","last_unstale":"2024-09-15T22:57:54.282904+0000","last_undegraded":"2024-09-15T22:57:54.282904+0000","last_fullsized":"2024-09-15T22:57:54.282904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:04.530501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270282+0000","last_change":"2024-09-15T22:57:54.264680+0000","last_active":"2024-09-15T22:57:54.270282+0000","last_peered":"2024-09-15T22:57:54.270282+0000","last_clean":"2024-09-15T22:57:54.270282+0000","last_became_active":"2024-09-15T22:57:54.264322+0000","last_became_peered":"2024-09-15T22:57:54.264322+0000","last_unstale":"2024-09-15T22:57:54.270282+0000","last_undegraded":"2024-09-15T22:57:54.270282+0000","last_fullsized":"2024-09-15T22:57:54.270282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:50.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.257347+0000","last_change":"2024-09-15T22:57:53.237559+0000","last_active":"2024-09-15T22:57:54.257347+0000","last_peered":"2024-09-15T22:57:54.257347+0000","last_clean":"2024-09-15T22:57:54.257347+0000","last_became_active":"2024-09-15T22:57:53.236248+0000","last_became_peered":"2024-09-15T22:57:53.236248+0000","last_unstale":"2024-09-15T22:57:54.257347+0000","last_undegraded":"2024-09-15T22:57:54.257347+0000","last_fullsized":"2024-09-15T22:57:54.257347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:16.980162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.265051+0000","last_change":"2024-09-15T22:57:54.261472+0000","last_active":"2024-09-15T22:57:54.265051+0000","last_peered":"2024-09-15T22:57:54.265051+0000","last_clean":"2024-09-15T22:57:54.265051+0000","last_became_active":"2024-09-15T22:57:54.261187+0000","last_became_peered":"2024-09-15T22:57:54.261187+0000","last_unstale":"2024-09-15T22:57:54.265051+0000","last_undegraded":"2024-09-15T22:57:54.265051+0000","last_fullsized":"2024-09-15T22:57:54.265051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:08.367100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.238774+0000","last_change":"2024-09-15T22:57:53.236543+0000","last_active":"2024-09-15T22:57:54.238774+0000","last_peered":"2024-09-15T22:57:54.238774+0000","last_clean":"2024-09-15T22:57:54.238774+0000","last_became_active":"2024-09-15T22:57:53.235956+0000","last_became_peered":"2024-09-15T22:57:53.235956+0000","last_unstale":"2024-09-15T22:57:54.238774+0000","last_undegraded":"2024-09-15T22:57:54.238774+0000","last_fullsized":"2024-09-15T22:57:54.238774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:45.531587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.263258+0000","last_change":"2024-09-15T22:57:54.255536+0000","last_active":"2024-09-15T22:57:54.263258+0000","last_peered":"2024-09-15T22:57:54.263258+0000","last_clean":"2024-09-15T22:57:54.263258+0000","last_became_active":"2024-09-15T22:57:54.255218+0000","last_became_peered":"2024-09-15T22:57:54.255218+0000","last_unstale":"2024-09-15T22:57:54.263258+0000","last_undegraded":"2024-09-15T22:57:54.263258+0000","last_fullsized":"2024-09-15T22:57:54.263258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:07.149477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.248451+0000","last_change":"2024-09-15T22:57:53.230621+0000","last_active":"2024-09-15T22:57:54.248451+0000","last_peered":"2024-09-15T22:57:54.248451+0000","last_clean":"2024-09-15T22:57:54.248451+0000","last_became_active":"2024-09-15T22:57:53.230263+0000","last_became_peered":"2024-09-15T22:57:53.230263+0000","last_unstale":"2024-09-15T22:57:54.248451+0000","last_undegraded":"2024-09-15T22:57:54.248451+0000","last_fullsized":"2024-09-15T22:57:54.248451+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:57.922586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.286055+0000","last_change":"2024-09-15T22:57:54.282224+0000","last_active":"2024-09-15T22:57:54.286055+0000","last_peered":"2024-09-15T22:57:54.286055+0000","last_clean":"2024-09-15T22:57:54.286055+0000","last_became_active":"2024-09-15T22:57:54.281595+0000","last_became_peered":"2024-09-15T22:57:54.281595+0000","last_unstale":"2024-09-15T22:57:54.286055+0000","last_undegraded":"2024-09-15T22:57:54.286055+0000","last_fullsized":"2024-09-15T22:57:54.286055+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:10.188013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.247073+0000","last_change":"2024-09-15T22:57:53.248361+0000","last_active":"2024-09-15T22:57:54.247073+0000","last_peered":"2024-09-15T22:57:54.247073+0000","last_clean":"2024-09-15T22:57:54.247073+0000","last_became_active":"2024-09-15T22:57:53.247606+0000","last_became_peered":"2024-09-15T22:57:53.247606+0000","last_unstale":"2024-09-15T22:57:54.247073+0000","last_undegraded":"2024-09-15T22:57:54.247073+0000","last_fullsized":"2024-09-15T22:57:54.247073+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:32.025453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.270527+0000","last_change":"2024-09-15T22:57:54.264040+0000","last_active":"2024-09-15T22:57:54.270527+0000","last_peered":"2024-09-15T22:57:54.270527+0000","last_clean":"2024-09-15T22:57:54.270527+0000","last_became_active":"2024-09-15T22:57:54.263728+0000","last_became_peered":"2024-09-15T22:57:54.263728+0000","last_unstale":"2024-09-15T22:57:54.270527+0000","last_undegraded":"2024-09-15T22:57:54.270527+0000","last_fullsized":"2024-09-15T22:57:54.270527+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:04.272611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.251326+0000","last_change":"2024-09-15T22:57:53.218317+0000","last_active":"2024-09-15T22:57:54.251326+0000","last_peered":"2024-09-15T22:57:54.251326+0000","last_clean":"2024-09-15T22:57:54.251326+0000","last_became_active":"2024-09-15T22:57:53.217629+0000","last_became_peered":"2024-09-15T22:57:53.217629+0000","last_unstale":"2024-09-15T22:57:54.251326+0000","last_undegraded":"2024-09-15T22:57:54.251326+0000","last_fullsized":"2024-09-15T22:57:54.251326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:12.976585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.262707+0000","last_change":"2024-09-15T22:57:54.259977+0000","last_active":"2024-09-15T22:57:54.262707+0000","last_peered":"2024-09-15T22:57:54.262707+0000","last_clean":"2024-09-15T22:57:54.262707+0000","last_became_active":"2024-09-15T22:57:54.259666+0000","last_became_peered":"2024-09-15T22:57:54.259666+0000","last_unstale":"2024-09-15T22:57:54.262707+0000","last_undegraded":"2024-09-15T22:57:54.262707+0000","last_fullsized":"2024-09-15T22:57:54.262707+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:52.210037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.235038+0000","last_change":"2024-09-15T22:57:53.243647+0000","last_active":"2024-09-15T22:57:54.235038+0000","last_peered":"2024-09-15T22:57:54.235038+0000","last_clean":"2024-09-15T22:57:54.235038+0000","last_became_active":"2024-09-15T22:57:53.242824+0000","last_became_peered":"2024-09-15T22:57:53.242824+0000","last_unstale":"2024-09-15T22:57:54.235038+0000","last_undegraded":"2024-09-15T22:57:54.235038+0000","last_fullsized":"2024-09-15T22:57:54.235038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:06.139522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.272292+0000","last_change":"2024-09-15T22:57:54.243803+0000","last_active":"2024-09-15T22:57:54.272292+0000","last_peered":"2024-09-15T22:57:54.272292+0000","last_clean":"2024-09-15T22:57:54.272292+0000","last_became_active":"2024-09-15T22:57:54.242975+0000","last_became_peered":"2024-09-15T22:57:54.242975+0000","last_unstale":"2024-09-15T22:57:54.272292+0000","last_undegraded":"2024-09-15T22:57:54.272292+0000","last_fullsized":"2024-09-15T22:57:54.272292+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:53.198032+0000","last_clean_scrub_stamp":"2024-09-15T22:57:53.198032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:32.155695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.254519+0000","last_change":"2024-09-15T22:57:53.238165+0000","last_active":"2024-09-15T22:57:54.254519+0000","last_peered":"2024-09-15T22:57:54.254519+0000","last_clean":"2024-09-15T22:57:54.254519+0000","last_became_active":"2024-09-15T22:57:53.237298+0000","last_became_peered":"2024-09-15T22:57:53.237298+0000","last_unstale":"2024-09-15T22:57:54.254519+0000","last_undegraded":"2024-09-15T22:57:54.254519+0000","last_fullsized":"2024-09-15T22:57:54.254519+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:57:52.188077+0000","last_clean_scrub_stamp":"2024-09-15T22:57:52.188077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:00.443379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-15T22:57:54.250958+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:57:54.250958+0000","last_peered":"2024-09-15T22:57:54.250958+0000","last_clean":"2024-09-15T22:57:54.250958+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:57:54.250958+0000","last_undegraded":"2024-09-15T22:57:54.250958+0000","last_fullsized":"2024-09-15T22:57:54.250958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1134592,"data_stored":808318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":540672,"data_stored":218478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":217826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":520192,"data_stored":211051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":548864,"data_stored":219460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":544768,"data_stored":219438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":540672,"data_stored":217986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":808250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:57:58.630 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:57:58.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:57:58.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.804+0000 7f745e479640 1 Processor -- start 2024-09-15T22:57:58.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.804+0000 7f745e479640 1 -- start start 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f745e479640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f745815b150 0x7f74580cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f745e479640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74580ce480 0x7f74580b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f745e479640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74580b2780 con 0x7f74580b2370 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f745e479640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f74580cce20 con 0x7f74580ce480 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f745e479640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f74580cf050 con 0x7f745815b150 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74580ce480 0x7f74580b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74580ce480 0x7f74580b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55906/0 (socket says 172.21.15.28:55906) 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 -- 172.21.15.28:0/1138953892 learned_addr learned my addr 172.21.15.28:0/1138953892 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f7457fff640 1 --2- 172.21.15.28:0/1138953892 >> v2:172.21.15.131:3300/0 conn(0x7f745815b150 0x7f74580cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 -- 172.21.15.28:0/1138953892 >> v2:172.21.15.131:3300/0 conn(0x7f745815b150 msgr2=0x7f74580cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 --2- 172.21.15.28:0/1138953892 >> v2:172.21.15.131:3300/0 conn(0x7f745815b150 0x7f74580cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 -- 172.21.15.28:0/1138953892 >> v1:172.21.15.131:6789/0 conn(0x7f74580b2370 legacy=0x7f74580b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:58.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 -- 172.21.15.28:0/1138953892 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74580cf330 con 0x7f74580ce480 2024-09-15T22:57:58.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f74577fe640 1 --2- 172.21.15.28:0/1138953892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74580ce480 0x7f74580b1e30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f74580b2b60 tx=0x7f744c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4bd217447034c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f7456ffd640 1 -- 172.21.15.28:0/1138953892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c0b0070 con 0x7f74580ce480 2024-09-15T22:57:58.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f7456ffd640 1 -- 172.21.15.28:0/1138953892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c0ab600 con 0x7f74580ce480 2024-09-15T22:57:58.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.808+0000 7f7456ffd640 1 -- 172.21.15.28:0/1138953892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c0ab9d0 con 0x7f74580ce480 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1138953892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74580ce480 msgr2=0x7f74580b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- 172.21.15.28:0/1138953892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74580ce480 0x7f74580b1e30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f74580b2b60 tx=0x7f744c01c240 comp rx=0 tx=0).stop 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1138953892 shutdown_connections 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- 172.21.15.28:0/1138953892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74580ce480 0x7f74580b1e30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- 172.21.15.28:0/1138953892 >> v2:172.21.15.131:3300/0 conn(0x7f745815b150 0x7f74580cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1138953892 >> 172.21.15.28:0/1138953892 conn(0x7f7458067e30 msgr2=0x7f745806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1138953892 shutdown_connections 2024-09-15T22:57:58.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1138953892 wait complete. 2024-09-15T22:57:58.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 Processor -- start 2024-09-15T22:57:58.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- start start 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74580b2370 0x7f74580ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74580ce480 0x7f7458155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7458167d20 con 0x7f745815b150 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f745815b530 con 0x7f74580b2370 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7458167ea0 con 0x7f74580ce480 2024-09-15T22:57:58.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55918/0 (socket says 172.21.15.28:55918) 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 -- 172.21.15.28:0/1662886267 learned_addr learned my addr 172.21.15.28:0/1662886267 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f7457fff640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74580b2370 0x7f74580ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f74577fe640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74580ce480 0x7f7458155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 -- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74580ce480 msgr2=0x7f7458155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74580ce480 0x7f7458155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 -- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74580b2370 msgr2=0x7f74580ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74580b2370 0x7f74580ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 -- 172.21.15.28:0/1662886267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74580abe60 con 0x7f745815b150 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745ca16640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f744800c3f0 tx=0x7f744800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448011790 con 0x7f745815b150 2024-09-15T22:57:58.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448017070 con 0x7f745815b150 2024-09-15T22:57:58.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74580ac140 con 0x7f745815b150 2024-09-15T22:57:58.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448011b70 con 0x7f745815b150 2024-09-15T22:57:58.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.812+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74580ac700 con 0x7f745815b150 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74580b1e30 con 0x7f745815b150 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7448011d10 con 0x7f745815b150 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f7454ff9640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 0x7f7444069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f7448085a20 con 0x7f745815b150 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f7457fff640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 0x7f7444069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:58.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.816+0000 7f7457fff640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 0x7f7444069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7458156610 tx=0x7f745000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:58.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:58.820+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74480565f0 con 0x7f745815b150 2024-09-15T22:57:59.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.036+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f74580af880 con 0x7f745815b150 2024-09-15T22:57:59.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f7454ff9640 1 -- 172.21.15.28:0/1662886267 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f7448055ef0 con 0x7f745815b150 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:57:59.043 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 msgr2=0x7f7444069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 0x7f7444069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7458156610 tx=0x7f745000b040 comp rx=0 tx=0).stop 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 msgr2=0x7f74580acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f744800c3f0 tx=0x7f744800c8b0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 shutdown_connections 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f745815b150 0x7f74580acf00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74580ce480 0x7f7458155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74440678f0 0x7f7444069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 --2- 172.21.15.28:0/1662886267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74580b2370 0x7f74580ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 >> 172.21.15.28:0/1662886267 conn(0x7f7458067e30 msgr2=0x7f745815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 shutdown_connections 2024-09-15T22:57:59.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.040+0000 7f745e479640 1 -- 172.21.15.28:0/1662886267 wait complete. 2024-09-15T22:57:59.061 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:57:59.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 Processor -- start 2024-09-15T22:57:59.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 -- start start 2024-09-15T22:57:59.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0c415e220 0x7fc0c406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c406c2a0 con 0x7fc0c40caba0 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c406c580 con 0x7fc0c4162950 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0cb3d3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c406c860 con 0x7fc0c415e220 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0c9970640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc0c40caba0 0x7fc0c40cb720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59356/0 (socket says 172.21.15.28:59356) 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0c9970640 1 -- 172.21.15.28:0/1146368668 learned_addr learned my addr 172.21.15.28:0/1146368668 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.180+0000 7fc0c916f640 1 --2- 172.21.15.28:0/1146368668 >> v2:172.21.15.28:3300/0 conn(0x7fc0c415e220 0x7fc0c406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0bbfff640 1 -- 172.21.15.28:0/1146368668 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793781719 0 0) 0x7fc0c406c2a0 con 0x7fc0c40caba0 2024-09-15T22:57:59.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0bbfff640 1 -- 172.21.15.28:0/1146368668 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b0003530 con 0x7fc0c40caba0 2024-09-15T22:57:59.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0c916f640 1 -- 172.21.15.28:0/1146368668 >> v1:172.21.15.131:6789/0 conn(0x7fc0c4162950 legacy=0x7fc0c40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0c916f640 1 -- 172.21.15.28:0/1146368668 >> v1:172.21.15.28:6789/0 conn(0x7fc0c40caba0 legacy=0x7fc0c40cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0c916f640 1 -- 172.21.15.28:0/1146368668 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c406cb40 con 0x7fc0c415e220 2024-09-15T22:57:59.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0c916f640 1 --2- 172.21.15.28:0/1146368668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c406bcc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00097c0 tx=0x7fc0c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db3aa9e663fc39e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0bbfff640 1 -- 172.21.15.28:0/1146368668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00b1070 con 0x7fc0c415e220 2024-09-15T22:57:59.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0bbfff640 1 -- 172.21.15.28:0/1146368668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c00ac600 con 0x7fc0c415e220 2024-09-15T22:57:59.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0bbfff640 1 -- 172.21.15.28:0/1146368668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00ac9d0 con 0x7fc0c415e220 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/1146368668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 msgr2=0x7fc0c406bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/1146368668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c406bcc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00097c0 tx=0x7fc0c001c470 comp rx=0 tx=0).stop 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/1146368668 shutdown_connections 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/1146368668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c406bcc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/1146368668 >> 172.21.15.28:0/1146368668 conn(0x7fc0c40cdbe0 msgr2=0x7fc0c40cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/1146368668 shutdown_connections 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.184+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/1146368668 wait complete. 2024-09-15T22:57:59.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 Processor -- start 2024-09-15T22:57:59.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- start start 2024-09-15T22:57:59.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 0x7fc0c414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0c4162950 0x7fc0c414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c415e780 con 0x7fc0c415e220 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c415e600 con 0x7fc0c4162950 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c416c2f0 con 0x7fc0c40caba0 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55946/0 (socket says 172.21.15.28:55946) 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 -- 172.21.15.28:0/3063970696 learned_addr learned my addr 172.21.15.28:0/3063970696 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c9970640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0c4162950 0x7fc0c414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c916f640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 0x7fc0c414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 -- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 msgr2=0x7fc0c414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 0x7fc0c414ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 -- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0c4162950 msgr2=0x7fc0c414b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0c4162950 0x7fc0c414b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 -- 172.21.15.28:0/3063970696 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c40b4f70 con 0x7fc0c415e220 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c916f640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 0x7fc0c414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0c896e640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c420 tx=0x7fc0b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40052d0 con 0x7fc0c415e220 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b4005470 con 0x7fc0c415e220 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c40b5250 con 0x7fc0c415e220 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4007260 con 0x7fc0c415e220 2024-09-15T22:57:59.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c40b5af0 con 0x7fc0c415e220 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.188+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c406bcc0 con 0x7fc0c415e220 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.192+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0b4007400 con 0x7fc0c415e220 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.192+0000 7fc0b9ffb640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 0x7fc0a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.192+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc0b4085200 con 0x7fc0c415e220 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.192+0000 7fc0c916f640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 0x7fc0a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.192+0000 7fc0c916f640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 0x7fc0a8069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00ae000 tx=0x7fc0c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.196+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0b4055ca0 con 0x7fc0c415e220 2024-09-15T22:57:59.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.388+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0c406de50 con 0x7fc0c415e220 2024-09-15T22:57:59.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.388+0000 7fc0b9ffb640 1 -- 172.21.15.28:0/3063970696 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7fc0b40555a0 con 0x7fc0c415e220 2024-09-15T22:57:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:57:59.393 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:57:59.393 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 msgr2=0x7fc0a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 0x7fc0a8069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00ae000 tx=0x7fc0c0008040 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 msgr2=0x7fc0c4160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c420 tx=0x7fc0b400c8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 shutdown_connections 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc0a80678f0 0x7fc0a8069db0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0c4162950 0x7fc0c414b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0c415e220 0x7fc0c4160480 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 --2- 172.21.15.28:0/3063970696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0c40caba0 0x7fc0c414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 >> 172.21.15.28:0/3063970696 conn(0x7fc0c40cdbe0 msgr2=0x7fc0c4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 shutdown_connections 2024-09-15T22:57:59.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.392+0000 7fc0cb3d3640 1 -- 172.21.15.28:0/3063970696 wait complete. 2024-09-15T22:57:59.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:57:53.585986+0000', 'modified': '2024-09-15T22:57:56.622901+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6837/4207620885', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6836', 'nonce': 4207620885}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 4207620885}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5250, 'qdb_cluster': [5250]} 2024-09-15T22:57:59.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:57:59.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:57:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 Processor -- start 2024-09-15T22:57:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 -- start start 2024-09-15T22:57:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe1d4145970 0x7fe1d40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1d40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d40d0960 con 0x7fe1d40d0190 2024-09-15T22:57:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d40d0f20 con 0x7fe1d4145970 2024-09-15T22:57:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d9bcd640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d40cd620 con 0x7fe1d40b2300 2024-09-15T22:57:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe1d40d0190 0x7fe1d4072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59360/0 (socket says 172.21.15.28:59360) 2024-09-15T22:57:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1200347879 learned_addr learned my addr 172.21.15.28:0/1200347879 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1d40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1200347879 >> v2:172.21.15.131:3300/0 conn(0x7fe1d4145970 0x7fe1d40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670609049 0 0) 0x7fe1d40d0960 con 0x7fe1d40d0190 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1bc003530 con 0x7fe1d40d0190 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753543705 0 0) 0x7fe1bc003530 con 0x7fe1d40d0190 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 msgr2=0x7fe1d40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1d40cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 >> v2:172.21.15.131:3300/0 conn(0x7fe1d4145970 msgr2=0x7fe1d40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 --2- 172.21.15.28:0/1200347879 >> v2:172.21.15.131:3300/0 conn(0x7fe1d4145970 0x7fe1d40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40d0c40 con 0x7fe1d40d0190 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fe1cc001a00 con 0x7fe1d40d0190 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 >> v1:172.21.15.28:6789/0 conn(0x7fe1d40d0190 legacy=0x7fe1d4072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1bc0039c0 0x7fe1bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1bc004810 0x7fe1bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40d0f20 con 0x7fe1bc0039c0 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40cd620 con 0x7fe1bc004810 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc00ba00 con 0x7fe1d40b2300 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.944+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1bc0039c0 0x7fe1bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1bc004810 0x7fe1bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 -- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 msgr2=0x7fe1bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1d40b2300 0x7fe1bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 -- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1bc004810 msgr2=0x7fe1bc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1bc004810 0x7fe1bc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 -- 172.21.15.28:0/1200347879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc003530 con 0x7fe1bc0039c0 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1bc0039c0 0x7fe1bc003de0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009ae0 tx=0x7fe1c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9deddbad5e2db631 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40096b0 con 0x7fe1bc0039c0 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40a8410 con 0x7fe1bc0039c0 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d27fc640 1 -- 172.21.15.28:0/1200347879 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40a8800 con 0x7fe1bc0039c0 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1200347879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1bc0039c0 msgr2=0x7fe1bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1200347879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1bc0039c0 0x7fe1bc003de0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009ae0 tx=0x7fe1c401ca50 comp rx=0 tx=0).stop 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1200347879 reap_dead start 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1200347879 shutdown_connections 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1200347879 >> 172.21.15.28:0/1200347879 conn(0x7fe1d406bcc0 msgr2=0x7fe1d406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1200347879 shutdown_connections 2024-09-15T22:57:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.948+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1200347879 wait complete. 2024-09-15T22:57:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 Processor -- start 2024-09-15T22:57:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- start start 2024-09-15T22:57:59.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 0x7fe1d41f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1d415f010 0x7fe1d41430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4166e50 con 0x7fe1d415f490 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4073140 con 0x7fe1d415f010 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d4166fd0 con 0x7fe1bc0039c0 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55962/0 (socket says 172.21.15.28:55962) 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1173087035 learned_addr learned my addr 172.21.15.28:0/1173087035 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1d415f010 0x7fe1d41430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 0x7fe1d41f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 msgr2=0x7fe1d41f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 0x7fe1d41f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1d415f010 msgr2=0x7fe1d41430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1d415f010 0x7fe1d41430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 -- 172.21.15.28:0/1173087035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d415dcf0 con 0x7fe1d415f490 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 0x7fe1d41f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc002070 tx=0x7fe1cc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1bbfff640 1 -- 172.21.15.28:0/1173087035 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00ebb0 con 0x7fe1d415f490 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1bbfff640 1 -- 172.21.15.28:0/1173087035 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc018070 con 0x7fe1d415f490 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d415dfd0 con 0x7fe1d415f490 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1bbfff640 1 -- 172.21.15.28:0/1173087035 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc013420 con 0x7fe1d415f490 2024-09-15T22:57:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d415e590 con 0x7fe1d415f490 2024-09-15T22:57:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1bbfff640 1 -- 172.21.15.28:0/1173087035 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1cc0135c0 con 0x7fe1d415f490 2024-09-15T22:57:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.952+0000 7fe1bbfff640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 0x7fe1c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1bbfff640 1 -- 172.21.15.28:0/1173087035 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe1cc085f90 con 0x7fe1d415f490 2024-09-15T22:57:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 0x7fe1c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 0x7fe1c0069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40af000 tx=0x7fe1c40b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 Processor -- start 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- start start 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f820d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f42f708b60 con 0x55f42f821290 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f42f66fc70 con 0x55f42f86b440 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f42f615ed0 con 0x55f42f86ab20 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55970/0 (socket says 172.21.15.28:55970) 2024-09-15T22:57:59.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 -- 172.21.15.28:0/718669834 learned_addr learned my addr 172.21.15.28:0/718669834 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 -- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 msgr2=0x55f42f86af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 -- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 msgr2=0x55f42f820d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f820d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 -- 172.21.15.28:0/718669834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42f627e50 con 0x55f42f821290 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00a040 tx=0x7fe1cc056c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af30e5b329afbfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1b97fa640 1 -- 172.21.15.28:0/718669834 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc05efb0 con 0x55f42f821290 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1b97fa640 1 -- 172.21.15.28:0/718669834 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0546d0 con 0x55f42f821290 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1b97fa640 1 -- 172.21.15.28:0/718669834 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc055820 con 0x55f42f821290 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- 172.21.15.28:0/718669834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 msgr2=0x55f42f821670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00a040 tx=0x7fe1cc056c10 comp rx=0 tx=0).stop 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- 172.21.15.28:0/718669834 shutdown_connections 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f821290 0x55f42f821670 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f820d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/718669834 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- 172.21.15.28:0/718669834 >> 172.21.15.28:0/718669834 conn(0x55f42f827600 msgr2=0x55f42f81f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- 172.21.15.28:0/718669834 shutdown_connections 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- 172.21.15.28:0/718669834 wait complete. 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 -- start start 2024-09-15T22:57:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.956+0000 7fe1dcc89000 1 Processor -- start 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f82bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f826390 0x55f42f82c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f42f6d1b00 con 0x55f42f86ab20 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f42f64a360 con 0x55f42f86b440 2024-09-15T22:57:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f42f6472d0 con 0x55f42f826390 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 10 client.0 _ll_register_callbacks cb 0x55f42f80c820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55980/0 (socket says 172.21.15.28:55980) 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 -- 172.21.15.28:0/3636536869 learned_addr learned my addr 172.21.15.28:0/3636536869 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f82bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 -- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f826390 msgr2=0x55f42f82c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f826390 0x55f42f82c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 -- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 msgr2=0x55f42f82bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f82bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 -- 172.21.15.28:0/3636536869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42f616120 con 0x55f42f86ab20 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f82bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40981c0 tx=0x7fe1bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a2d9688255b4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:57:59.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40a8860 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe1c40c6aa0 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1cc0546d0 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe1c40c6ca0 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 10 client.5382 fetch_fsmap learned FSMap version 26 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f42f60f450 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0546d0 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe1c40a7070 con 0x55f42f86ab20 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 10 client.5382 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 10 client.5382 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 20 client.5382 populate_metadata read hostname 'smithi028' 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f879280 0x55f42f87b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 4 client.5382 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 --> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f42f609c00 con 0x55f42f879280 2024-09-15T22:57:59.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f879280 0x55f42f87b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f879280 0x55f42f87b670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3c38d2267de9fa server_cookie=f303cc8f30ca19be in_seq=0 out_seq=0 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 10 client.5382 ms_handle_connect on v2:172.21.15.28:6836/4207620885 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 1 -- 172.21.15.28:0/3636536869 <== mds.0 v2:172.21.15.28:6836/4207620885 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f42f609c00 con 0x55f42f879280 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 10 client.5382 handle_command_reply: tid=0 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 client.5382 shutdown 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 msgr2=0x55f42f825e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40981c0 tx=0x7fe1bc005840 comp rx=0 tx=0).stop 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 shutdown_connections 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f879280 0x55f42f87b670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f826390 0x55f42f82c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f82bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/3636536869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f825e50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1b27fc640 0 client.5382 ms_handle_reset on v2:172.21.15.28:6836/4207620885 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 >> 172.21.15.28:0/3636536869 conn(0x55f42f821290 msgr2=0x55f42f81fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 shutdown_connections 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 1 -- 172.21.15.28:0/3636536869 wait complete. 2024-09-15T22:57:59.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.960+0000 7fe1dcc89000 20 client.5382 trim_cache size 0 max 16384 2024-09-15T22:57:59.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 Processor -- start 2024-09-15T22:57:59.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- start start 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f87b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4203620 con 0x55f42f826390 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4202980 con 0x55f42f86b440 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d4202fd0 con 0x55f42f86ab20 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55994/0 (socket says 172.21.15.28:55994) 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 -- 172.21.15.28:0/2139726575 learned_addr learned my addr 172.21.15.28:0/2139726575 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 -- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 msgr2=0x55f42f86a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 -- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 msgr2=0x55f42f87b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f87b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f87b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 -- 172.21.15.28:0/2139726575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42f5f6fd0 con 0x55f42f826390 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4000c10 tx=0x7fe1c40c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8fa938712099cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1b8ff9640 1 -- 172.21.15.28:0/2139726575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40a8ad0 con 0x55f42f826390 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1b8ff9640 1 -- 172.21.15.28:0/2139726575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40a8c70 con 0x55f42f826390 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1b8ff9640 1 -- 172.21.15.28:0/2139726575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40a8e60 con 0x55f42f826390 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- 172.21.15.28:0/2139726575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 msgr2=0x55f42f869cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4000c10 tx=0x7fe1c40c2000 comp rx=0 tx=0).stop 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- 172.21.15.28:0/2139726575 shutdown_connections 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f86b440 0x55f42f87b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86ab20 0x55f42f86a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/2139726575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f826390 0x55f42f869cc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- 172.21.15.28:0/2139726575 >> 172.21.15.28:0/2139726575 conn(0x55f42f821290 msgr2=0x55f42f825650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- 172.21.15.28:0/2139726575 shutdown_connections 2024-09-15T22:57:59.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.980+0000 7fe1dcc89000 1 -- 172.21.15.28:0/2139726575 wait complete. 2024-09-15T22:57:59.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- start start 2024-09-15T22:57:59.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 Processor -- start 2024-09-15T22:57:59.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f826390 0x55f42f87e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86b440 0x55f42f899ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55f42f66ef80 con 0x55f42f86ab20 2024-09-15T22:57:59.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55f42f627ca0 con 0x55f42f826390 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55f42f6742a0 con 0x55f42f86b440 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 10 client.0 _ll_register_callbacks cb 0x7fe1bc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56002/0 (socket says 172.21.15.28:56002) 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 -- 172.21.15.28:0/1767191512 learned_addr learned my addr 172.21.15.28:0/1767191512 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d3fff640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86b440 0x55f42f899ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f826390 0x55f42f87e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 -- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86b440 msgr2=0x55f42f899ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86b440 0x55f42f899ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 -- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f826390 msgr2=0x55f42f87e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f826390 0x55f42f87e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 -- 172.21.15.28:0/1767191512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42f6f2750 con 0x55f42f86ab20 2024-09-15T22:57:59.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d2ffd640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55f42f66d3a0 tx=0x7fe1c8017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43338094c7b073f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8024060 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe1c8004030 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c40a8c70 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe1c802a050 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 10 client.5388 fetch_fsmap learned FSMap version 26 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f42f5fda30 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40a8c70 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe1c802d020 con 0x55f42f86ab20 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 10 client.5388 fetch_fsmap finished waiting for FSMap version 26 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 10 client.5388 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 20 client.5388 populate_metadata read hostname 'smithi028' 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f89a3e0 0x55f42f8dde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:59.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 4 client.5388 mds_command: new command op to 5250 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 --> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] -- command(tid 0: {"prefix": "status"}) -- 0x55f42f67d3a0 con 0x55f42f89a3e0 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f89a3e0 0x55f42f8dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 10 client.5388 ms_handle_connect on v2:172.21.15.28:6836/4207620885 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d37fe640 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f89a3e0 0x55f42f8dde80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f42b4cfabd12308 server_cookie=717340e54587ef75 in_seq=0 out_seq=0 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 1 -- 172.21.15.28:0/1767191512 <== mds.0 v2:172.21.15.28:6836/4207620885 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f42f67d3a0 con 0x55f42f89a3e0 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 10 client.5388 handle_command_reply: tid=0 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 client.5388 shutdown 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 msgr2=0x55f42f899960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55f42f66d3a0 tx=0x7fe1c8017810 comp rx=0 tx=0).stop 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 shutdown_connections 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:6836/4207620885,v1:172.21.15.28:6837/4207620885] conn(0x55f42f89a3e0 0x55f42f8dde80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f42f86b440 0x55f42f899ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f42f86ab20 0x55f42f899960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1b27fc640 0 client.5388 ms_handle_reset on v2:172.21.15.28:6836/4207620885 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 --2- 172.21.15.28:0/1767191512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f42f826390 0x55f42f87e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 >> 172.21.15.28:0/1767191512 conn(0x55f42f821290 msgr2=0x55f42f868cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 shutdown_connections 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 1 -- 172.21.15.28:0/1767191512 wait complete. 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1dcc89000 20 client.5388 trim_cache size 0 max 16384 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "f44574f1-d935-4d4e-b79e-1e1910665f93", 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5250, 2024-09-15T22:57:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 5.7419326039999996, 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 26, 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 46, 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 46, 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 10.717811373 2024-09-15T22:57:59.996 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:57:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.984+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 msgr2=0x7fe1c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 0x7fe1c0069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40af000 tx=0x7fe1c40b2040 comp rx=0 tx=0).stop 2024-09-15T22:57:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 msgr2=0x7fe1d41435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc002070 tx=0x7fe1cc00e530 comp rx=0 tx=0).stop 2024-09-15T22:57:59.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 shutdown_connections 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1d415f490 0x7fe1d41435e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe1c00678c0 0x7fe1c0069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1d415f010 0x7fe1d41430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 --2- 172.21.15.28:0/1173087035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1bc0039c0 0x7fe1d41f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 >> 172.21.15.28:0/1173087035 conn(0x7fe1d406bcc0 msgr2=0x7fe1d40af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 shutdown_connections 2024-09-15T22:57:59.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:57:59.988+0000 7fe1d9bcd640 1 -- 172.21.15.28:0/1173087035 wait complete. 2024-09-15T22:58:00.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:58:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 Processor -- start 2024-09-15T22:58:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 -- start start 2024-09-15T22:58:00.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c9415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c94160a00 con 0x7f8c94153380 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c9415c910 con 0x7f8c9415d3f0 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c9a014640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9415cbf0 con 0x7f8c940cff40 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c937fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8c94153380 0x7f8c940cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59374/0 (socket says 172.21.15.28:59374) 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c937fe640 1 -- 172.21.15.28:0/1033837367 learned_addr learned my addr 172.21.15.28:0/1033837367 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144359483 0 0) 0x7f8c94160a00 con 0x7f8c94153380 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c9415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c7c003530 con 0x7f8c94153380 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2195167559 0 0) 0x7f8c7c003530 con 0x7f8c94153380 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 msgr2=0x7f8c9415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c9415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 >> v1:172.21.15.131:6789/0 conn(0x7f8c9415d3f0 legacy=0x7f8c94160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9415ced0 con 0x7f8c94153380 2024-09-15T22:58:00.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f8c84001680 con 0x7f8c94153380 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 >> v1:172.21.15.28:6789/0 conn(0x7f8c94153380 legacy=0x7f8c940cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7c0039f0 0x7f8c7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7c004d50 0x7f8c7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9415cbf0 con 0x7f8c7c004d50 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c00bab0 con 0x7f8c7c0039f0 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c00bcb0 con 0x7f8c940cff40 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7c004d50 0x7f8c7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c937fe640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7c0039f0 0x7f8c7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 -- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 msgr2=0x7f8c7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 -- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7c0039f0 msgr2=0x7f8c7c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:00.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c7c0039f0 0x7f8c7c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c93fff640 1 -- 172.21.15.28:0/1033837367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c003530 con 0x7f8c7c004d50 2024-09-15T22:58:00.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.108+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940cff40 0x7f8c7c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:00.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c93fff640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7c004d50 0x7f8c7c0051d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001e70 tx=0x7f8c8c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faf43b0984eef62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c001a90 con 0x7f8c7c004d50 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c003b80 con 0x7f8c7c004d50 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c927fc640 1 -- 172.21.15.28:0/1033837367 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c005080 con 0x7f8c7c004d50 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- 172.21.15.28:0/1033837367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7c004d50 msgr2=0x7f8c7c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 --2- 172.21.15.28:0/1033837367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7c004d50 0x7f8c7c0051d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001e70 tx=0x7f8c8c01c780 comp rx=0 tx=0).stop 2024-09-15T22:58:00.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c93fff640 1 -- 172.21.15.28:0/1033837367 reap_dead start 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- 172.21.15.28:0/1033837367 shutdown_connections 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- 172.21.15.28:0/1033837367 >> 172.21.15.28:0/1033837367 conn(0x7f8c940b0a10 msgr2=0x7f8c940b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- 172.21.15.28:0/1033837367 shutdown_connections 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- 172.21.15.28:0/1033837367 wait complete. 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 Processor -- start 2024-09-15T22:58:00.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.112+0000 7f8c9a014640 1 -- start start 2024-09-15T22:58:00.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c941f48a0 0x7f8c9414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c9414cf00 0x7f8c9414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94160080 con 0x7f8c941509d0 2024-09-15T22:58:00.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9415ff00 con 0x7f8c941f48a0 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8c94162e50 con 0x7f8c9414cf00 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56014/0 (socket says 172.21.15.28:56014) 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 -- 172.21.15.28:0/597191954 learned_addr learned my addr 172.21.15.28:0/597191954 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c93fff640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c9414cf00 0x7f8c9414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c937fe640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c941f48a0 0x7f8c9414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 -- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c9414cf00 msgr2=0x7f8c9414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c9414cf00 0x7f8c9414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 -- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c941f48a0 msgr2=0x7f8c9414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c941f48a0 0x7f8c9414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 -- 172.21.15.28:0/597191954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9414dbf0 con 0x7f8c941509d0 2024-09-15T22:58:00.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c92ffd640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c880108d0 tx=0x7f8c88010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800f040 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8800eb60 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9414ded0 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8801c400 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c940cd9e0 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c94160960 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c8801c5a0 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 0x7f8c80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f8c88086410 con 0x7f8c941509d0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c937fe640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 0x7f8c80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:00.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.116+0000 7f8c937fe640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 0x7f8c80069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c941606d0 tx=0x7f8c84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:00.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.120+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c88018030 con 0x7f8c941509d0 2024-09-15T22:58:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.320+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c940754d0 con 0x7f8c941509d0 2024-09-15T22:58:00.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c7bfff640 1 -- 172.21.15.28:0/597191954 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f8c88056f50 con 0x7f8c941509d0 2024-09-15T22:58:00.329 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 msgr2=0x7f8c80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 0x7f8c80069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c941606d0 tx=0x7f8c84009040 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 msgr2=0x7f8c9414f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c880108d0 tx=0x7f8c88010d90 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 shutdown_connections 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c9414cf00 0x7f8c9414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c941509d0 0x7f8c9414f890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8c800678c0 0x7f8c80069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 --2- 172.21.15.28:0/597191954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c941f48a0 0x7f8c9414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 >> 172.21.15.28:0/597191954 conn(0x7f8c940b0a10 msgr2=0x7f8c9406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:00.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 shutdown_connections 2024-09-15T22:58:00.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00.324+0000 7f8c9a014640 1 -- 172.21.15.28:0/597191954 wait complete. 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:58:00.344 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:58:00.345 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:00.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.345 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:58:00.351 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42376sec preferred_lft 42376sec 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:58:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:58:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:00.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.354 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:58:00.402 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:58:00.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.403 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:58:00.451 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:58:00.451 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:58:00.452 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:58:00.452 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:58:00.452 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:58:00.452 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:58:00.452 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:58:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:58:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:00.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.566 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:58:00.618 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:58:00.619 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:58:00.619 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:00.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.619 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:58:00.676 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:58:00.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:00.677 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:00.722 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:00.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:00.723 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:00.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:00.828 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:00.876 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:00.878 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:00.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:00.879 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:00.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:58:00.927 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:58:00.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:00.987 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:01.037 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:01.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:01.038 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:01.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:58:01.048+0000 7fbe9866e580 -1 init, newargv = 0x5638985bb710 newargc=15 2024-09-15T22:58:01.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39251]: starting ceph client 2024-09-15T22:58:01.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39251]: starting fuse 2024-09-15T22:58:02.157 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:02.173 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:02.224 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:02.225 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:02.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:02.227 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:02.275 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:58:02.275 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:58:02.275 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:58:02.275 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:58:02.275 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:02.276 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:58:02.401 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.39251.asok 2024-09-15T22:58:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:02.414 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39251.asok 2024-09-15T22:58:02.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:02.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39251.asok status 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:58:02.574 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "39251", 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5400, 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5400 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:02.575 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 611108946 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 611108946 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5400 192.168.0.1:0/611108946", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/611108946", 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 26, 2024-09-15T22:58:02.576 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 46, 2024-09-15T22:58:02.577 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:58:02.577 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:58:02.577 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:58:02.577 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:02.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:02.588 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:58:02.588 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:02.594 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:58:02.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:02.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:02.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:02.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:02.650 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-09-15T22:58:02.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-09-15T22:58:02.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 Processor -- start 2024-09-15T22:58:02.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 -- start start 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f372815b150 0x7f37280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280cf050 con 0x7f37280ce480 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280cf330 con 0x7f37280b2540 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.892+0000 7f372ffa2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f37280cce20 con 0x7f372815b150 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372dd3e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f372815b150 0x7f37280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372d53d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f37280ce480 0x7f37280b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54332/0 (socket says 172.21.15.28:54332) 2024-09-15T22:58:02.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372d53d640 1 -- 172.21.15.28:0/2631185119 learned_addr learned my addr 172.21.15.28:0/2631185119 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372dd3e640 1 -- 172.21.15.28:0/2631185119 >> v1:172.21.15.131:6789/0 conn(0x7f37280b2540 legacy=0x7f3728072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372dd3e640 1 -- 172.21.15.28:0/2631185119 >> v1:172.21.15.28:6789/0 conn(0x7f37280ce480 legacy=0x7f37280b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372cd3c640 1 -- 172.21.15.28:0/2631185119 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161993121 0 0) 0x7f37280cf050 con 0x7f37280ce480 2024-09-15T22:58:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372dd3e640 1 -- 172.21.15.28:0/2631185119 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280cf610 con 0x7f372815b150 2024-09-15T22:58:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372dd3e640 1 --2- 172.21.15.28:0/2631185119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f372815b150 0x7f37280cdc00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3724009d90 tx=0x7f372401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939a7666353f1014 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372cd3c640 1 -- 172.21.15.28:0/2631185119 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37240b2070 con 0x7f372815b150 2024-09-15T22:58:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372cd3c640 1 -- 172.21.15.28:0/2631185119 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37240a5930 con 0x7f372815b150 2024-09-15T22:58:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.896+0000 7f372cd3c640 1 -- 172.21.15.28:0/2631185119 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37240a5d00 con 0x7f372815b150 2024-09-15T22:58:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2631185119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f372815b150 msgr2=0x7f37280cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2631185119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f372815b150 0x7f37280cdc00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3724009d90 tx=0x7f372401c870 comp rx=0 tx=0).stop 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2631185119 shutdown_connections 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2631185119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f372815b150 0x7f37280cdc00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2631185119 >> 172.21.15.28:0/2631185119 conn(0x7f3728067e30 msgr2=0x7f372806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2631185119 shutdown_connections 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2631185119 wait complete. 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 Processor -- start 2024-09-15T22:58:02.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- start start 2024-09-15T22:58:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 0x7f37280ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 0x7f3728148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f37280734c0 con 0x7f37280ce480 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3728073340 con 0x7f372815b150 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3728073640 con 0x7f37280b2540 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48454/0 (socket says 172.21.15.28:48454) 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 -- 172.21.15.28:0/2759759801 learned_addr learned my addr 172.21.15.28:0/2759759801 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372e53f640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 0x7f3728148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372dd3e640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 0x7f37280ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 -- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 msgr2=0x7f37280ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 0x7f37280ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 -- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 msgr2=0x7f3728148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 0x7f3728148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 -- 172.21.15.28:0/2759759801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280b4170 con 0x7f37280ce480 2024-09-15T22:58:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372dd3e640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 0x7f37280ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372e53f640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 0x7f3728148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372d53d640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37180011f0 tx=0x7f371800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718018070 con 0x7f37280ce480 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37180074e0 con 0x7f37280ce480 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372814c190 con 0x7f37280ce480 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718004a10 con 0x7f37280ce480 2024-09-15T22:58:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.900+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37280cba30 con 0x7f37280ce480 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37280cdc00 con 0x7f37280ce480 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f371801b070 con 0x7f37280ce480 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f371e7fc640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 0x7f370c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f3718085010 con 0x7f37280ce480 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f372dd3e640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 0x7f370c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.904+0000 7f372dd3e640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 0x7f370c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37240af000 tx=0x7f37240a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:02.908+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3718055b10 con 0x7f37280ce480 2024-09-15T22:58:03.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.132+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) -- 0x7f37280cc970 con 0x7f37280ce480 2024-09-15T22:58:03.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.136+0000 7f371e7fc640 1 -- 172.21.15.28:0/2759759801 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) ==== 183+0+140 (secure 0 0 0) 0x7f3718055410 con 0x7f37280ce480 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow r pool=cephfs_data" 2024-09-15T22:58:03.142 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 msgr2=0x7f370c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 0x7f370c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37240af000 tx=0x7f37240a7070 comp rx=0 tx=0).stop 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 msgr2=0x7f37280cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37180011f0 tx=0x7f371800c9b0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 shutdown_connections 2024-09-15T22:58:03.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f370c0678c0 0x7f370c069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f372815b150 0x7f3728148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37280ce480 0x7f37280cb000 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 --2- 172.21.15.28:0/2759759801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37280b2540 0x7f37280ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 >> 172.21.15.28:0/2759759801 conn(0x7f3728067e30 msgr2=0x7f37280b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 shutdown_connections 2024-09-15T22:58:03.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.140+0000 7f372ffa2640 1 -- 172.21.15.28:0/2759759801 wait complete. 2024-09-15T22:58:03.161 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:03.162 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:03.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:58:03.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 Processor -- start 2024-09-15T22:58:03.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 -- start start 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efdb00b5200 0x7efdb015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb00b55e0 con 0x7efdb00b1dc0 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7efdb00ce3b0 con 0x7efdb00b5200 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb8478640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efdb015c5f0 con 0x7efdb00cca90 2024-09-15T22:58:03.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6a15640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efdb00b1dc0 0x7efdb00b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54346/0 (socket says 172.21.15.28:54346) 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6a15640 1 -- 172.21.15.28:0/3562588390 learned_addr learned my addr 172.21.15.28:0/3562588390 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6214640 1 --2- 172.21.15.28:0/3562588390 >> v2:172.21.15.28:3300/0 conn(0x7efdb00b5200 0x7efdb015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb5a13640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb5212640 1 -- 172.21.15.28:0/3562588390 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1138604511 0 0) 0x7efdb00b55e0 con 0x7efdb00b1dc0 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb5212640 1 -- 172.21.15.28:0/3562588390 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c003530 con 0x7efdb00b1dc0 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6214640 1 -- 172.21.15.28:0/3562588390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 msgr2=0x7efdb00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6214640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6214640 1 -- 172.21.15.28:0/3562588390 >> v1:172.21.15.28:6789/0 conn(0x7efdb00b1dc0 legacy=0x7efdb00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.340+0000 7efdb6214640 1 -- 172.21.15.28:0/3562588390 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb00b4910 con 0x7efdb00b5200 2024-09-15T22:58:03.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb6214640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb015c0b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097f0 tx=0x7efdac01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd718458198cfeb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb5212640 1 -- 172.21.15.28:0/3562588390 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac0b0070 con 0x7efdb00b5200 2024-09-15T22:58:03.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb5212640 1 -- 172.21.15.28:0/3562588390 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac0ab600 con 0x7efdb00b5200 2024-09-15T22:58:03.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb5212640 1 -- 172.21.15.28:0/3562588390 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac0ab9d0 con 0x7efdb00b5200 2024-09-15T22:58:03.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 -- 172.21.15.28:0/3562588390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 msgr2=0x7efdb015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb015c0b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097f0 tx=0x7efdac01c410 comp rx=0 tx=0).stop 2024-09-15T22:58:03.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 -- 172.21.15.28:0/3562588390 shutdown_connections 2024-09-15T22:58:03.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 --2- 172.21.15.28:0/3562588390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb015c0b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 -- 172.21.15.28:0/3562588390 >> 172.21.15.28:0/3562588390 conn(0x7efdb006bcc0 msgr2=0x7efdb006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 -- 172.21.15.28:0/3562588390 shutdown_connections 2024-09-15T22:58:03.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.344+0000 7efdb8478640 1 -- 172.21.15.28:0/3562588390 wait complete. 2024-09-15T22:58:03.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 Processor -- start 2024-09-15T22:58:03.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- start start 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdb00b1dc0 0x7efdb01f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00b4070 con 0x7efdb00b5200 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00cd8c0 con 0x7efdb00b1dc0 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efdb00b25e0 con 0x7efdb00cca90 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48474/0 (socket says 172.21.15.28:48474) 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 -- 172.21.15.28:0/4214600189 learned_addr learned my addr 172.21.15.28:0/4214600189 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb6a15640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 -- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 msgr2=0x7efdb0154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb0154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 -- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdb00b1dc0 msgr2=0x7efdb01f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb6214640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdb00b1dc0 0x7efdb01f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdb00b1dc0 0x7efdb01f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 -- 172.21.15.28:0/4214600189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb0159550 con 0x7efdb00b5200 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb5a13640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efda000fb00 tx=0x7efda000d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0011450 con 0x7efdb00b5200 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda0011610 con 0x7efdb00b5200 2024-09-15T22:58:03.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0011a00 con 0x7efdb00b5200 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb0159830 con 0x7efdb00b5200 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb015a7d0 con 0x7efdb00b5200 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.348+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb015c0b0 con 0x7efdb00b5200 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.352+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efda0019020 con 0x7efdb00b5200 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.352+0000 7efda6ffd640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 0x7efd94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.352+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7efda00886e0 con 0x7efdb00b5200 2024-09-15T22:58:03.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.352+0000 7efdb6214640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 0x7efd94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.352+0000 7efdb6214640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 0x7efd94069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efdac0ad000 tx=0x7efdac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.356+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efda00591e0 con 0x7efdb00b5200 2024-09-15T22:58:03.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.536+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efdb0068530 con 0x7efdb00b5200 2024-09-15T22:58:03.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.536+0000 7efda6ffd640 1 -- 172.21.15.28:0/4214600189 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7efda0058ae0 con 0x7efdb00b5200 2024-09-15T22:58:03.539 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 msgr2=0x7efd94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 0x7efd94069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efdac0ad000 tx=0x7efdac008040 comp rx=0 tx=0).stop 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 msgr2=0x7efdb0158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efda000fb00 tx=0x7efda000d2f0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 shutdown_connections 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdb00cca90 0x7efdb0154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdb00b5200 0x7efdb0158b70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7efd940678c0 0x7efd94069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 --2- 172.21.15.28:0/4214600189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdb00b1dc0 0x7efdb01f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 >> 172.21.15.28:0/4214600189 conn(0x7efdb006bcc0 msgr2=0x7efdb0166230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 shutdown_connections 2024-09-15T22:58:03.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.540+0000 7efdb8478640 1 -- 172.21.15.28:0/4214600189 wait complete. 2024-09-15T22:58:03.559 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:03.559 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:03.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:58:03.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 Processor -- start 2024-09-15T22:58:03.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 -- start start 2024-09-15T22:58:03.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d40b24d0 0x7f91d40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d40cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d40d0960 con 0x7f91d4145970 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f91d40d0f20 con 0x7f91d40b24d0 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91dbd13640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40cd620 con 0x7f91d40d0190 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d40b24d0 0x7f91d40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91d40b24d0 0x7f91d40cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48490/0 (socket says 172.21.15.28:48490) 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 -- 172.21.15.28:0/3420353869 learned_addr learned my addr 172.21.15.28:0/3420353869 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91da2b0640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d40cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 -- 172.21.15.28:0/3420353869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 msgr2=0x7f91d40cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d40cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 -- 172.21.15.28:0/3420353869 >> v1:172.21.15.131:6789/0 conn(0x7f91d4145970 legacy=0x7f91d40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:03.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.728+0000 7f91d92ae640 1 -- 172.21.15.28:0/3420353869 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d40d0c40 con 0x7f91d40b24d0 2024-09-15T22:58:03.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91d92ae640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d40b24d0 0x7f91d40cfc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91d40afd50 tx=0x7f91c801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeac71193bf365a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91d8aad640 1 -- 172.21.15.28:0/3420353869 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c80b0070 con 0x7f91d40b24d0 2024-09-15T22:58:03.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91d8aad640 1 -- 172.21.15.28:0/3420353869 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c80ab600 con 0x7f91d40b24d0 2024-09-15T22:58:03.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91d8aad640 1 -- 172.21.15.28:0/3420353869 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c80ab9d0 con 0x7f91d40b24d0 2024-09-15T22:58:03.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- 172.21.15.28:0/3420353869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d40b24d0 msgr2=0x7f91d40cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d40b24d0 0x7f91d40cfc50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f91d40afd50 tx=0x7f91c801c420 comp rx=0 tx=0).stop 2024-09-15T22:58:03.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- 172.21.15.28:0/3420353869 shutdown_connections 2024-09-15T22:58:03.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d40cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3420353869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d40b24d0 0x7f91d40cfc50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- 172.21.15.28:0/3420353869 >> 172.21.15.28:0/3420353869 conn(0x7f91d406bcc0 msgr2=0x7f91d406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- 172.21.15.28:0/3420353869 shutdown_connections 2024-09-15T22:58:03.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- 172.21.15.28:0/3420353869 wait complete. 2024-09-15T22:58:03.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 Processor -- start 2024-09-15T22:58:03.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.732+0000 7f91dbd13640 1 -- start start 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d40b24d0 0x7f91d40abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d41403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ce980 con 0x7f91d4145970 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ce800 con 0x7f91d40b24d0 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40ceb00 con 0x7f91d40d0190 2024-09-15T22:58:03.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48492/0 (socket says 172.21.15.28:48492) 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 -- 172.21.15.28:0/3544894752 learned_addr learned my addr 172.21.15.28:0/3544894752 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d9aaf640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d40b24d0 0x7f91d40abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d92ae640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d41403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 -- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 msgr2=0x7f91d41403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d41403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 -- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d40b24d0 msgr2=0x7f91d40abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d40b24d0 0x7f91d40abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 -- 172.21.15.28:0/3544894752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d40ab760 con 0x7f91d4145970 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91da2b0640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f91c400afd0 tx=0x7f91c400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4015070 con 0x7f91d4145970 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c4004220 con 0x7f91d4145970 2024-09-15T22:58:03.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4003620 con 0x7f91d4145970 2024-09-15T22:58:03.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d4142110 con 0x7f91d4145970 2024-09-15T22:58:03.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d413fbc0 con 0x7f91d4145970 2024-09-15T22:58:03.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d40cfc50 con 0x7f91d4145970 2024-09-15T22:58:03.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91c40037c0 con 0x7f91d4145970 2024-09-15T22:58:03.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 0x7f91c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:03.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f91c4085d40 con 0x7f91d4145970 2024-09-15T22:58:03.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.736+0000 7f91d9aaf640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 0x7f91c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:03.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.740+0000 7f91d9aaf640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 0x7f91c0069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91cc005530 tx=0x7f91cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:03.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.740+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91c4056840 con 0x7f91d4145970 2024-09-15T22:58:03.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.920+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91d40ccb40 con 0x7f91d4145970 2024-09-15T22:58:03.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.920+0000 7f91d27fc640 1 -- 172.21.15.28:0/3544894752 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f91c4056140 con 0x7f91d4145970 2024-09-15T22:58:03.926 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 msgr2=0x7f91c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 0x7f91c0069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f91cc005530 tx=0x7f91cc009040 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 msgr2=0x7f91d413dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f91c400afd0 tx=0x7f91c400ca20 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 shutdown_connections 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91d4145970 0x7f91d413dd60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91d40d0190 0x7f91d41403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f91c00678c0 0x7f91c0069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 --2- 172.21.15.28:0/3544894752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91d40b24d0 0x7f91d40abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 >> 172.21.15.28:0/3544894752 conn(0x7f91d406bcc0 msgr2=0x7f91d40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 shutdown_connections 2024-09-15T22:58:03.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:03.924+0000 7f91dbd13640 1 -- 172.21.15.28:0/3544894752 wait complete. 2024-09-15T22:58:03.944 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:58:03.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:03.944 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:03.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39251]: fuse finished with error 0 and tester_r 0 2024-09-15T22:58:03.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:04.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:04.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.039 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:58:04.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:58:04.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 Processor -- start 2024-09-15T22:58:04.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 -- start start 2024-09-15T22:58:04.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 0x7f679c0d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0d2ba0 con 0x7f679c06d870 2024-09-15T22:58:04.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0d2e80 con 0x7f679c15e820 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f67a2238640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0d3160 con 0x7f679c0b3610 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f679c06d870 0x7f679c06dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54348/0 (socket says 172.21.15.28:54348) 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679b7fe640 1 -- 172.21.15.28:0/97694053 learned_addr learned my addr 172.21.15.28:0/97694053 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679bfff640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 0x7f679c0d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 169605257 0 0) 0x7f679c0d2ba0 con 0x7f679c06d870 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6788003530 con 0x7f679c06d870 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3596199273 0 0) 0x7f6788003530 con 0x7f679c06d870 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 msgr2=0x7f679c0d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 0x7f679c0d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 >> v1:172.21.15.131:6789/0 conn(0x7f679c15e820 legacy=0x7f679c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0d3440 con 0x7f679c06d870 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f678c001a00 con 0x7f679c06d870 2024-09-15T22:58:04.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 >> v1:172.21.15.28:6789/0 conn(0x7f679c06d870 legacy=0x7f679c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67880039f0 0x7f6788003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6788004810 0x7f6788004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 0x7f67880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0d3160 con 0x7f6788004810 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f678800ba80 con 0x7f67880039f0 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f678800bc50 con 0x7f679c0b3610 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6788004810 0x7f6788004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679b7fe640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67880039f0 0x7f6788003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 -- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 msgr2=0x7f67880051d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0b3610 0x7f67880051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 -- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67880039f0 msgr2=0x7f6788003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67880039f0 0x7f6788003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.212+0000 7f679affd640 1 -- 172.21.15.28:0/97694053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6788003530 con 0x7f6788004810 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f679affd640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6788004810 0x7f6788004c90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6784003db0 tx=0x7f678401c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c059c86a0b85826f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67840b0070 con 0x7f6788004810 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67840ab620 con 0x7f6788004810 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f679a7fc640 1 -- 172.21.15.28:0/97694053 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67840039b0 con 0x7f6788004810 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- 172.21.15.28:0/97694053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6788004810 msgr2=0x7f6788004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 --2- 172.21.15.28:0/97694053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6788004810 0x7f6788004c90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6784003db0 tx=0x7f678401c2c0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f679bfff640 1 -- 172.21.15.28:0/97694053 reap_dead start 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- 172.21.15.28:0/97694053 shutdown_connections 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- 172.21.15.28:0/97694053 >> 172.21.15.28:0/97694053 conn(0x7f679c0d4910 msgr2=0x7f679c0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- 172.21.15.28:0/97694053 shutdown_connections 2024-09-15T22:58:04.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- 172.21.15.28:0/97694053 wait complete. 2024-09-15T22:58:04.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 Processor -- start 2024-09-15T22:58:04.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.216+0000 7f67a2238640 1 -- start start 2024-09-15T22:58:04.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0b8950 0x7f679c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0cb810 0x7f679c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0d3dc0 con 0x7f679c0b8d30 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0d3c40 con 0x7f679c0b8950 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0d3f40 con 0x7f679c0cb810 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48510/0 (socket says 172.21.15.28:48510) 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 -- 172.21.15.28:0/3373126577 learned_addr learned my addr 172.21.15.28:0/3373126577 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679b7fe640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0b8950 0x7f679c0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679bfff640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0cb810 0x7f679c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 -- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0cb810 msgr2=0x7f679c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0cb810 0x7f679c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 -- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0b8950 msgr2=0x7f679c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0b8950 0x7f679c0b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 -- 172.21.15.28:0/3373126577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0cbdd0 con 0x7f679c0b8d30 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679affd640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f678401c300 tx=0x7f6788005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67840b9020 con 0x7f679c0b8d30 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67840ab9f0 con 0x7f679c0b8d30 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c0cc0b0 con 0x7f679c0b8d30 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67840b0040 con 0x7f679c0b8d30 2024-09-15T22:58:04.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c0cc670 con 0x7f679c0b8d30 2024-09-15T22:58:04.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c0d4350 con 0x7f679c0b8d30 2024-09-15T22:58:04.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67840bc020 con 0x7f679c0b8d30 2024-09-15T22:58:04.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 0x7f677c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f678411fec0 con 0x7f679c0b8d30 2024-09-15T22:58:04.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.220+0000 7f679b7fe640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 0x7f677c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.224+0000 7f679b7fe640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 0x7f677c069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f678c002240 tx=0x7f678c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.224+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f67840c3030 con 0x7f679c0b8d30 2024-09-15T22:58:04.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.424+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f679c0cf6e0 con 0x7f679c0b8d30 2024-09-15T22:58:04.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f6793fff640 1 -- 172.21.15.28:0/3373126577 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f6784015fd0 con 0x7f679c0b8d30 2024-09-15T22:58:04.430 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 msgr2=0x7f677c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 0x7f677c069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f678c002240 tx=0x7f678c009040 comp rx=0 tx=0).stop 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 msgr2=0x7f679c14f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f678401c300 tx=0x7f6788005840 comp rx=0 tx=0).stop 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 shutdown_connections 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f679c0cb810 0x7f679c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f679c0b8d30 0x7f679c14f780 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f677c0678f0 0x7f677c069db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 --2- 172.21.15.28:0/3373126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0b8950 0x7f679c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 >> 172.21.15.28:0/3373126577 conn(0x7f679c0d4910 msgr2=0x7f679c06dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 shutdown_connections 2024-09-15T22:58:04.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04.428+0000 7f67a2238640 1 -- 172.21.15.28:0/3373126577 wait complete. 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:58:04.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:58:04.451 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:58:04.451 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:04.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.451 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:58:04.457 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42372sec preferred_lft 42372sec 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.458 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.459 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:04.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.461 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:58:04.510 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:58:04.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.581 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:58:04.633 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:58:04.633 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:58:04.634 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:58:04.634 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:58:04.634 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:58:04.634 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:58:04.634 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:58:04.634 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:58:04.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:58:04.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:58:04.635 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:58:04.635 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:58:04.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:58:04.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:04.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.769 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:58:04.774 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:58:04.774 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:58:04.774 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:04.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:58:04.830 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:58:04.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:04.830 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:04.879 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:04.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:04.880 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:04.927 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:04.984 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:05.033 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:05.034 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:05.035 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:05.036 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:05.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:05.036 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:05.079 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:58:05.079 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:58:05.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:05.142 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:05.191 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:05.192 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:05.193 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:05.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:05.194 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:05.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:58:05.208+0000 7ff4bd7bf580 -1 init, newargv = 0x55980d7c0100 newargc=15 2024-09-15T22:58:05.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39448]: starting ceph client 2024-09-15T22:58:05.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39448]: starting fuse 2024-09-15T22:58:06.320 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:06.336 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:06.385 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:06.385 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:06.385 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:06.386 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:06.387 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:06.388 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:06.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:06.389 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:06.439 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:58:06.439 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:06.439 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:58:06.440 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:58:06.441 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:58:06.441 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:58:06.441 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:06.441 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:58:06.441 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:58:06.567 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.39448.asok 2024-09-15T22:58:06.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:06.580 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39448.asok 2024-09-15T22:58:06.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:06.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39448.asok status 2024-09-15T22:58:06.737 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:06.737 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:58:06.737 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:58:06.737 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "39448", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5433, 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5433 2024-09-15T22:58:06.738 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2199109594 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2199109594 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:06.739 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5433 192.168.0.1:0/2199109594", 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/2199109594", 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 26, 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 48, 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:58:06.740 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:06.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:06.751 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:58:06.751 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:06.757 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:58:06.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:06.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:06.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:06.808 DEBUG:teuthology.orchestra.run.smithi028:> stdin-killer -- python3 -c ' 2024-09-15T22:58:06.808 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:58:06.808 DEBUG:teuthology.orchestra.run.smithi028:> import errno 2024-09-15T22:58:06.808 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> try: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> if False: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> ret = os.read(fd, 1024) 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> else: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> os.write(fd, b'"'"'content'"'"') 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> except OSError as e: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> if e.errno != errno.EPERM: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> raise 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> else: 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("client does not check permission of data pool") 2024-09-15T22:58:06.809 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:58:06.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:06.928 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-09-15T22:58:07.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.100+0000 7fea01f45640 1 Processor -- start 2024-09-15T22:58:07.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.100+0000 7fea01f45640 1 -- start start 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fea01f45640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe9fc0b2540 0x7fe9fc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fea01f45640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe9fc0ce480 0x7fe9fc072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fea01f45640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0cf050 con 0x7fe9fc15b150 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fea01f45640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0cce20 con 0x7fe9fc0ce480 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fea01f45640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0cf330 con 0x7fe9fc0b2540 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe9fc0ce480 0x7fe9fc072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe9fc0ce480 0x7fe9fc072420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48520/0 (socket says 172.21.15.28:48520) 2024-09-15T22:58:07.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 -- 172.21.15.28:0/3705046927 learned_addr learned my addr 172.21.15.28:0/3705046927 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9faffd640 1 --2- 172.21.15.28:0/3705046927 >> v2:172.21.15.131:3300/0 conn(0x7fe9fc0b2540 0x7fe9fc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 -- 172.21.15.28:0/3705046927 >> v2:172.21.15.131:3300/0 conn(0x7fe9fc0b2540 msgr2=0x7fe9fc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 --2- 172.21.15.28:0/3705046927 >> v2:172.21.15.131:3300/0 conn(0x7fe9fc0b2540 0x7fe9fc0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 -- 172.21.15.28:0/3705046927 >> v1:172.21.15.131:6789/0 conn(0x7fe9fc15b150 legacy=0x7fe9fc0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 -- 172.21.15.28:0/3705046927 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc0cf610 con 0x7fe9fc0ce480 2024-09-15T22:58:07.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fbfff640 1 --2- 172.21.15.28:0/3705046927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc072420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc073b10 tx=0x7fe9f401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3d1b49b8a32e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fa7fc640 1 -- 172.21.15.28:0/3705046927 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a57b0 con 0x7fe9fc0ce480 2024-09-15T22:58:07.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fa7fc640 1 -- 172.21.15.28:0/3705046927 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40a5950 con 0x7fe9fc0ce480 2024-09-15T22:58:07.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.104+0000 7fe9fa7fc640 1 -- 172.21.15.28:0/3705046927 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a5d20 con 0x7fe9fc0ce480 2024-09-15T22:58:07.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/3705046927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0ce480 msgr2=0x7fe9fc072420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- 172.21.15.28:0/3705046927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc072420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc073b10 tx=0x7fe9f401c8f0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/3705046927 shutdown_connections 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- 172.21.15.28:0/3705046927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc072420 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- 172.21.15.28:0/3705046927 >> v2:172.21.15.131:3300/0 conn(0x7fe9fc0b2540 0x7fe9fc0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/3705046927 >> 172.21.15.28:0/3705046927 conn(0x7fe9fc067e30 msgr2=0x7fe9fc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/3705046927 shutdown_connections 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/3705046927 wait complete. 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 Processor -- start 2024-09-15T22:58:07.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- start start 2024-09-15T22:58:07.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9fc0b2540 0x7fe9fc14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0732f0 con 0x7fe9fc15b150 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc073170 con 0x7fe9fc0ce480 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc073470 con 0x7fe9fc0b2540 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48524/0 (socket says 172.21.15.28:48524) 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 -- 172.21.15.28:0/2316601359 learned_addr learned my addr 172.21.15.28:0/2316601359 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fb7fe640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9fc0b2540 0x7fe9fc14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9faffd640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 -- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9fc0b2540 msgr2=0x7fe9fc14b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9fc0b2540 0x7fe9fc14b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 -- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 msgr2=0x7fe9fc1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 -- 172.21.15.28:0/2316601359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc151750 con 0x7fe9fc15b150 2024-09-15T22:58:07.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9faffd640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9fbfff640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401a520 tx=0x7fe9f4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40bc020 con 0x7fe9fc15b150 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40b8670 con 0x7fe9fc15b150 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc152a60 con 0x7fe9fc15b150 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b8aa0 con 0x7fe9fc15b150 2024-09-15T22:58:07.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.108+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc150c70 con 0x7fe9fc15b150 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9fc072420 con 0x7fe9fc15b150 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9f40bf020 con 0x7fe9fc15b150 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fe9f3fff640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fe9f4120d10 con 0x7fe9fc15b150 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fe9fb7fe640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.112+0000 7fe9fb7fe640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400b810 tx=0x7fe9e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.116+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9f40c6030 con 0x7fe9fc15b150 2024-09-15T22:58:07.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.348+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) -- 0x7fe9fc1530a0 con 0x7fe9fc15b150 2024-09-15T22:58:07.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fe9f3fff640 1 -- 172.21.15.28:0/2316601359 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) ==== 183+0+140 (secure 0 0 0) 0x7fe9f40165a0 con 0x7fe9fc15b150 2024-09-15T22:58:07.354 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:58:07.354 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:58:07.354 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:58:07.355 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:58:07.355 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow w pool=cephfs_data" 2024-09-15T22:58:07.355 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 msgr2=0x7fe9dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400b810 tx=0x7fe9e4008040 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 msgr2=0x7fe9fc157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401a520 tx=0x7fe9f4019690 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 shutdown_connections 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc15b150 0x7fe9fc157930 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9fc0ce480 0x7fe9fc1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 --2- 172.21.15.28:0/2316601359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9fc0b2540 0x7fe9fc14b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 >> 172.21.15.28:0/2316601359 conn(0x7fe9fc067e30 msgr2=0x7fe9fc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:07.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 shutdown_connections 2024-09-15T22:58:07.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.352+0000 7fea01f45640 1 -- 172.21.15.28:0/2316601359 wait complete. 2024-09-15T22:58:07.374 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:07.374 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:07.379 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:58:07.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.544+0000 7f8317994640 1 Processor -- start 2024-09-15T22:58:07.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.544+0000 7f8317994640 1 -- start start 2024-09-15T22:58:07.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.544+0000 7f8317994640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f831006d870 0x7f831006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83100b3610 0x7f83100d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f831006e190 con 0x7f831006d870 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f83100d2ba0 con 0x7f83100b3610 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f83100d2e80 con 0x7f831015e820 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f831006d870 0x7f831006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f831006d870 0x7f831006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48534/0 (socket says 172.21.15.28:48534) 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 -- 172.21.15.28:0/3039183326 learned_addr learned my addr 172.21.15.28:0/3039183326 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315f31640 1 --2- 172.21.15.28:0/3039183326 >> v2:172.21.15.131:3300/0 conn(0x7f83100b3610 0x7f83100d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8314f2f640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 -- 172.21.15.28:0/3039183326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 msgr2=0x7f83100cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 -- 172.21.15.28:0/3039183326 >> v2:172.21.15.131:3300/0 conn(0x7f83100b3610 msgr2=0x7f83100d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 --2- 172.21.15.28:0/3039183326 >> v2:172.21.15.131:3300/0 conn(0x7f83100b3610 0x7f83100d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 -- 172.21.15.28:0/3039183326 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100d3160 con 0x7f831006d870 2024-09-15T22:58:07.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8314f2f640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:07.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8315730640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f831006d870 0x7f831006dc50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f83100ced20 tx=0x7f830c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c474987076884c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8307fff640 1 -- 172.21.15.28:0/3039183326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b5070 con 0x7f831006d870 2024-09-15T22:58:07.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8307fff640 1 -- 172.21.15.28:0/3039183326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0a89d0 con 0x7f831006d870 2024-09-15T22:58:07.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8307fff640 1 -- 172.21.15.28:0/3039183326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0a8da0 con 0x7f831006d870 2024-09-15T22:58:07.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- 172.21.15.28:0/3039183326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f831006d870 msgr2=0x7f831006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f831006d870 0x7f831006dc50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f83100ced20 tx=0x7f830c01ed10 comp rx=0 tx=0).stop 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- 172.21.15.28:0/3039183326 shutdown_connections 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- 172.21.15.28:0/3039183326 >> v2:172.21.15.131:3300/0 conn(0x7f83100b3610 0x7f83100d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 --2- 172.21.15.28:0/3039183326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f831006d870 0x7f831006dc50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- 172.21.15.28:0/3039183326 >> 172.21.15.28:0/3039183326 conn(0x7f83100d4910 msgr2=0x7f83100d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- 172.21.15.28:0/3039183326 shutdown_connections 2024-09-15T22:58:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.548+0000 7f8317994640 1 -- 172.21.15.28:0/3039183326 wait complete. 2024-09-15T22:58:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 Processor -- start 2024-09-15T22:58:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- start start 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f831006d870 0x7f8310152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f83100cfc90 con 0x7f83100b3610 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f83100d3720 con 0x7f831006d870 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f83100d4180 con 0x7f831015e820 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48542/0 (socket says 172.21.15.28:48542) 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 -- 172.21.15.28:0/4166857364 learned_addr learned my addr 172.21.15.28:0/4166857364 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8315730640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f831006d870 0x7f8310152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8315f31640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 -- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 msgr2=0x7f83100caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 -- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f831006d870 msgr2=0x7f8310152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f831006d870 0x7f8310152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 -- 172.21.15.28:0/4166857364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100cc4d0 con 0x7f83100b3610 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8314f2f640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f830000c7f0 tx=0x7f830000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300015070 con 0x7f83100b3610 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8300004220 con 0x7f83100b3610 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83100cc7b0 con 0x7f83100b3610 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300003620 con 0x7f83100b3610 2024-09-15T22:58:07.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.552+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83100c85b0 con 0x7f83100b3610 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83100b4b50 con 0x7f83100b3610 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83000039d0 con 0x7f83100b3610 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8305ffb640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 0x7f82f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f8300085c50 con 0x7f83100b3610 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8315730640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 0x7f82f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.556+0000 7f8315730640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 0x7f82f4069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f830c0b2000 tx=0x7f830c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.560+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83000560e0 con 0x7f83100b3610 2024-09-15T22:58:07.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83100b4870 con 0x7f83100b3610 2024-09-15T22:58:07.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8305ffb640 1 -- 172.21.15.28:0/4166857364 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f830005a3e0 con 0x7f83100b3610 2024-09-15T22:58:07.739 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 msgr2=0x7f82f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 0x7f82f4069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f830c0b2000 tx=0x7f830c009040 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 msgr2=0x7f83100ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f830000c7f0 tx=0x7f830000ccb0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 shutdown_connections 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f831015e820 0x7f83100caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83100b3610 0x7f83100ca570 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f82f40678c0 0x7f82f4069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 --2- 172.21.15.28:0/4166857364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f831006d870 0x7f8310152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.736+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 >> 172.21.15.28:0/4166857364 conn(0x7f83100d4910 msgr2=0x7f8310160c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:07.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.740+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 shutdown_connections 2024-09-15T22:58:07.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.740+0000 7f8317994640 1 -- 172.21.15.28:0/4166857364 wait complete. 2024-09-15T22:58:07.760 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:07.760 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:07.766 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:58:07.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 Processor -- start 2024-09-15T22:58:07.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 -- start start 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56941625b0 0x7f56940d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5694162990 0x7f5694073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f56940b4380 0x7f56940b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f56940b8650 con 0x7f5694162990 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f56940b77a0 con 0x7f56940b4380 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56994f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f56940b7a40 con 0x7f56941625b0 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f568bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5694162990 0x7f5694073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f568bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5694162990 0x7f5694073ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48546/0 (socket says 172.21.15.28:48546) 2024-09-15T22:58:07.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f568bfff640 1 -- 172.21.15.28:0/603701256 learned_addr learned my addr 172.21.15.28:0/603701256 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f56937fe640 1 --2- 172.21.15.28:0/603701256 >> v2:172.21.15.131:3300/0 conn(0x7f56940b4380 0x7f56940b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.932+0000 7f5692ffd640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56941625b0 0x7f56940d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 -- 172.21.15.28:0/603701256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56941625b0 msgr2=0x7f56940d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56941625b0 0x7f56940d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 -- 172.21.15.28:0/603701256 >> v2:172.21.15.131:3300/0 conn(0x7f56940b4380 msgr2=0x7f56940b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 --2- 172.21.15.28:0/603701256 >> v2:172.21.15.131:3300/0 conn(0x7f56940b4380 0x7f56940b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 -- 172.21.15.28:0/603701256 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940b7d20 con 0x7f5694162990 2024-09-15T22:58:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f568bfff640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694162990 0x7f5694073ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5694073a20 tx=0x7f567c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ed5c2c34ca3645 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56927fc640 1 -- 172.21.15.28:0/603701256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0b1070 con 0x7f5694162990 2024-09-15T22:58:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56927fc640 1 -- 172.21.15.28:0/603701256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c0ac630 con 0x7f5694162990 2024-09-15T22:58:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56927fc640 1 -- 172.21.15.28:0/603701256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0a8050 con 0x7f5694162990 2024-09-15T22:58:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 -- 172.21.15.28:0/603701256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694162990 msgr2=0x7f5694073ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694162990 0x7f5694073ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5694073a20 tx=0x7f567c01c520 comp rx=0 tx=0).stop 2024-09-15T22:58:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 -- 172.21.15.28:0/603701256 shutdown_connections 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 --2- 172.21.15.28:0/603701256 >> v2:172.21.15.131:3300/0 conn(0x7f56940b4380 0x7f56940b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694162990 0x7f5694073ce0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 --2- 172.21.15.28:0/603701256 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56941625b0 0x7f56940d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 -- 172.21.15.28:0/603701256 >> 172.21.15.28:0/603701256 conn(0x7f5694067a00 msgr2=0x7f5694067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 -- 172.21.15.28:0/603701256 shutdown_connections 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.936+0000 7f56994f8640 1 -- 172.21.15.28:0/603701256 wait complete. 2024-09-15T22:58:07.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 Processor -- start 2024-09-15T22:58:07.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- start start 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 0x7f569415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5694162990 0x7f5694160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d1d40 con 0x7f56940b4380 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d1bc0 con 0x7f56941625b0 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f569406dab0 con 0x7f5694162990 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48552/0 (socket says 172.21.15.28:48552) 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 -- 172.21.15.28:0/1011361138 learned_addr learned my addr 172.21.15.28:0/1011361138 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f568bfff640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 0x7f569415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 -- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5694162990 msgr2=0x7f5694160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56937fe640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5694162990 0x7f5694160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5694162990 0x7f5694160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 -- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 msgr2=0x7f569415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 0x7f569415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 -- 172.21.15.28:0/1011361138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940b13f0 con 0x7f56940b4380 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f568bfff640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 0x7f569415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f5692ffd640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f568400d800 tx=0x7f568400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400b660 con 0x7f56940b4380 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5684019070 con 0x7f56940b4380 2024-09-15T22:58:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400ba80 con 0x7f56940b4380 2024-09-15T22:58:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56940b1110 con 0x7f56940b4380 2024-09-15T22:58:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569415b0a0 con 0x7f56940b4380 2024-09-15T22:58:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.940+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569406de30 con 0x7f56940b4380 2024-09-15T22:58:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.944+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f568400bc20 con 0x7f56940b4380 2024-09-15T22:58:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.944+0000 7f568b7fe640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 0x7f5674069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.944+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5684086060 con 0x7f56940b4380 2024-09-15T22:58:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.944+0000 7f568bfff640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 0x7f5674069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.944+0000 7f568bfff640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 0x7f5674069db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ae000 tx=0x7f567c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:07.948+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5684056bf0 con 0x7f56940b4380 2024-09-15T22:58:08.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.124+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5694073ea0 con 0x7f56940b4380 2024-09-15T22:58:08.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.124+0000 7f568b7fe640 1 -- 172.21.15.28:0/1011361138 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f56840564f0 con 0x7f56940b4380 2024-09-15T22:58:08.129 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 msgr2=0x7f5674069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 0x7f5674069db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ae000 tx=0x7f567c0a7000 comp rx=0 tx=0).stop 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 msgr2=0x7f569415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f568400d800 tx=0x7f568400dcc0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 shutdown_connections 2024-09-15T22:58:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5694162990 0x7f5694160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f56740678f0 0x7f5674069db0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56941625b0 0x7f569415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 --2- 172.21.15.28:0/1011361138 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56940b4380 0x7f569415a410 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 >> 172.21.15.28:0/1011361138 conn(0x7f5694067a00 msgr2=0x7f569406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 shutdown_connections 2024-09-15T22:58:08.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.128+0000 7f56994f8640 1 -- 172.21.15.28:0/1011361138 wait complete. 2024-09-15T22:58:08.147 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:58:08.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:08.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39448]: fuse finished with error 0 and tester_r 0 2024-09-15T22:58:08.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:08.200 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:08.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.200 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:58:08.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:58:08.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 Processor -- start 2024-09-15T22:58:08.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 -- start start 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57940cde30 0x7f57940b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f579415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57940b4bd0 con 0x7f57940b4710 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f579415f260 con 0x7f57940cde30 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f579a5d6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f57940b4080 con 0x7f57940ce210 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57940cde30 0x7f57940b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57940cde30 0x7f57940b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48554/0 (socket says 172.21.15.28:48554) 2024-09-15T22:58:08.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 -- 172.21.15.28:0/2147218649 learned_addr learned my addr 172.21.15.28:0/2147218649 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:08.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5798b73640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f579415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 -- 172.21.15.28:0/2147218649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 msgr2=0x7f579415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:08.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f579415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 -- 172.21.15.28:0/2147218649 >> v1:172.21.15.131:6789/0 conn(0x7f57940b4710 legacy=0x7f57940ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.364+0000 7f5793fff640 1 -- 172.21.15.28:0/2147218649 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57940b4eb0 con 0x7f57940cde30 2024-09-15T22:58:08.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5793fff640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f57940b3b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57880098a0 tx=0x7f578801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23edf911293e5a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:08.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5792ffd640 1 -- 172.21.15.28:0/2147218649 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880b1070 con 0x7f57940cde30 2024-09-15T22:58:08.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5792ffd640 1 -- 172.21.15.28:0/2147218649 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57880ac640 con 0x7f57940cde30 2024-09-15T22:58:08.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5792ffd640 1 -- 172.21.15.28:0/2147218649 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880aca10 con 0x7f57940cde30 2024-09-15T22:58:08.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- 172.21.15.28:0/2147218649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 msgr2=0x7f57940b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f57940b3b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57880098a0 tx=0x7f578801c480 comp rx=0 tx=0).stop 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- 172.21.15.28:0/2147218649 shutdown_connections 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f579415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- 172.21.15.28:0/2147218649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f57940b3b40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- 172.21.15.28:0/2147218649 >> 172.21.15.28:0/2147218649 conn(0x7f579406bcc0 msgr2=0x7f579406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- 172.21.15.28:0/2147218649 shutdown_connections 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- 172.21.15.28:0/2147218649 wait complete. 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 Processor -- start 2024-09-15T22:58:08.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- start start 2024-09-15T22:58:08.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 0x7f5794154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f57941530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57940d0050 con 0x7f57940cde30 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f57940cfed0 con 0x7f57940b4710 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f579a5d6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f57940d01d0 con 0x7f57940ce210 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48568/0 (socket says 172.21.15.28:48568) 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 -- 172.21.15.28:0/3365529990 learned_addr learned my addr 172.21.15.28:0/3365529990 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5793fff640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 0x7f5794154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 -- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 msgr2=0x7f57941530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5798b73640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f57941530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f57941530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 -- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 msgr2=0x7f5794154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 0x7f5794154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f57937fe640 1 -- 172.21.15.28:0/3365529990 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794141000 con 0x7f57940cde30 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.368+0000 7f5793fff640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 0x7f5794154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:08.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f57937fe640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f578400c420 tx=0x7f578400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:08.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57840052d0 con 0x7f57940cde30 2024-09-15T22:58:08.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784005470 con 0x7f57940cde30 2024-09-15T22:58:08.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784007260 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5794153aa0 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5794154060 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57940b3b40 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5784007400 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 0x7f5780069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5784085190 con 0x7f57940cde30 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5793fff640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 0x7f5780069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:08.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.372+0000 7f5793fff640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 0x7f5780069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57880ae000 tx=0x7f5788008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:08.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.376+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5784055c90 con 0x7f57940cde30 2024-09-15T22:58:08.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f57940d0eb0 con 0x7f57940cde30 2024-09-15T22:58:08.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f5790ff9640 1 -- 172.21.15.28:0/3365529990 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f5784055590 con 0x7f57940cde30 2024-09-15T22:58:08.583 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 msgr2=0x7f5780069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 0x7f5780069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57880ae000 tx=0x7f5788008040 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 msgr2=0x7f5794140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f578400c420 tx=0x7f578400c8e0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 shutdown_connections 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57940ce210 0x7f57941530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57940cde30 0x7f5794140ac0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57800678c0 0x7f5780069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 --2- 172.21.15.28:0/3365529990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57940b4710 0x7f5794154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 >> 172.21.15.28:0/3365529990 conn(0x7f579406bcc0 msgr2=0x7f57940ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 shutdown_connections 2024-09-15T22:58:08.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08.580+0000 7f579a5d6640 1 -- 172.21.15.28:0/3365529990 wait complete. 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:58:08.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:58:08.603 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:58:08.603 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:08.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.603 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-09-15T22:58:08.608 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:58:08.609 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42368sec preferred_lft 42368sec 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:e6:af:e0:67 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:58:08.610 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:58:08.611 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:58:08.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.612 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:58:08.660 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-09-15T22:58:08.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.661 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:58:08.707 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:58:08.708 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-09-15T22:58:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:58:08.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:08.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.831 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:58:08.837 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:58:08.837 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:58:08.837 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:08.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:08.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-09-15T22:58:08.889 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T22:58:08.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:08.889 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:08.934 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:58:08.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:58:08.934 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:08.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:09.040 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:09.088 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:09.089 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:09.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:09.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:09.091 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:09.138 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:58:09.139 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T22:58:09.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:09.199 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:09.246 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:09.247 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:09.248 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:09.249 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:09.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:09.250 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:09.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:2024-09-15T22:58:09.260+0000 7fcf8cadc580 -1 init, newargv = 0x559b488c94a0 newargc=15 2024-09-15T22:58:09.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39644]: starting ceph client 2024-09-15T22:58:09.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39644]: starting fuse 2024-09-15T22:58:10.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-09-15T22:58:10.389 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:58:10.445 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:58:10.446 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:58:10.447 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:10.448 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:10.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:10.449 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-09-15T22:58:10.495 INFO:teuthology.orchestra.run.smithi028.stdout:45 2024-09-15T22:58:10.495 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T22:58:10.495 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:58:10.495 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-09-15T22:58:10.495 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-09-15T22:58:10.495 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:58:10.496 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.0")) 2024-09-15T22:58:10.497 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:58:10.622 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.0.39644.asok 2024-09-15T22:58:10.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:10.635 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39644.asok 2024-09-15T22:58:10.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:10.635 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39644.asok status 2024-09-15T22:58:10.798 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "0", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "39644", 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5463, 2024-09-15T22:58:10.799 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 5463 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 412680408 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-09-15T22:58:10.800 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 412680408 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.5463 192.168.0.1:0/412680408", 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/412680408", 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 26, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 48, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-09-15T22:58:10.801 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:10.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:10.813 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-09-15T22:58:10.813 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:10.818 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-09-15T22:58:10.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:10.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:10.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:10.873 DEBUG:teuthology.orchestra.run.smithi028:> stdin-killer -- python3 -c ' 2024-09-15T22:58:10.873 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-09-15T22:58:10.873 DEBUG:teuthology.orchestra.run.smithi028:> import errno 2024-09-15T22:58:10.873 DEBUG:teuthology.orchestra.run.smithi028:> 2024-09-15T22:58:10.873 DEBUG:teuthology.orchestra.run.smithi028:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> try: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> if True: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> ret = os.read(fd, 1024) 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> else: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> os.write(fd, b'"'"'content'"'"') 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> except OSError as e: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> if e.errno != errno.EPERM: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> raise 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> else: 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("client does not check permission of data pool") 2024-09-15T22:58:10.874 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-09-15T22:58:10.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:58:11.001 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-09-15T22:58:11.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 Processor -- start 2024-09-15T22:58:11.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 -- start start 2024-09-15T22:58:11.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480b96d0 0x7f8e480d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8e480b69b0 0x7f8e48161130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e480b74b0 con 0x7f8e480d3940 2024-09-15T22:58:11.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f8e480d2a70 con 0x7f8e480b69b0 2024-09-15T22:58:11.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e4d829640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8e480d2d50 con 0x7f8e480b96d0 2024-09-15T22:58:11.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e477fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8e480b69b0 0x7f8e48161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e467fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8e480d3940 0x7f8e480b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54360/0 (socket says 172.21.15.28:54360) 2024-09-15T22:58:11.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e467fc640 1 -- 172.21.15.28:0/2055840854 learned_addr learned my addr 172.21.15.28:0/2055840854 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:11.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e46ffd640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480b96d0 0x7f8e480d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e477fe640 1 -- 172.21.15.28:0/2055840854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480b96d0 msgr2=0x7f8e480d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e477fe640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480b96d0 0x7f8e480d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e477fe640 1 -- 172.21.15.28:0/2055840854 >> v1:172.21.15.28:6789/0 conn(0x7f8e480d3940 legacy=0x7f8e480b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e477fe640 1 -- 172.21.15.28:0/2055840854 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e480d3030 con 0x7f8e480b69b0 2024-09-15T22:58:11.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.180+0000 7f8e45ffb640 1 -- 172.21.15.28:0/2055840854 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053249804 0 0) 0x7f8e480b74b0 con 0x7f8e480d3940 2024-09-15T22:58:11.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e477fe640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b69b0 0x7f8e48161130 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff460cfea312dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e45ffb640 1 -- 172.21.15.28:0/2055840854 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e400b2070 con 0x7f8e480b69b0 2024-09-15T22:58:11.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e45ffb640 1 -- 172.21.15.28:0/2055840854 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e400a57a0 con 0x7f8e480b69b0 2024-09-15T22:58:11.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e45ffb640 1 -- 172.21.15.28:0/2055840854 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e400a5b70 con 0x7f8e480b69b0 2024-09-15T22:58:11.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- 172.21.15.28:0/2055840854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b69b0 msgr2=0x7f8e48161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b69b0 0x7f8e48161130 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4001c8e0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- 172.21.15.28:0/2055840854 shutdown_connections 2024-09-15T22:58:11.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b69b0 0x7f8e48161130 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 --2- 172.21.15.28:0/2055840854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480b96d0 0x7f8e480d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- 172.21.15.28:0/2055840854 >> 172.21.15.28:0/2055840854 conn(0x7f8e480d1330 msgr2=0x7f8e480d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- 172.21.15.28:0/2055840854 shutdown_connections 2024-09-15T22:58:11.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- 172.21.15.28:0/2055840854 wait complete. 2024-09-15T22:58:11.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 Processor -- start 2024-09-15T22:58:11.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.184+0000 7f8e4d829640 1 -- start start 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e480b69b0 0x7f8e48150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 0x7f8e48158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480b7990 con 0x7f8e480b96d0 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480cfaf0 con 0x7f8e480b69b0 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8e480b7b10 con 0x7f8e480d3940 2024-09-15T22:58:11.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48592/0 (socket says 172.21.15.28:48592) 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 -- 172.21.15.28:0/3294889393 learned_addr learned my addr 172.21.15.28:0/3294889393 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e46ffd640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e480b69b0 0x7f8e48150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e477fe640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 0x7f8e48158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 -- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 msgr2=0x7f8e48158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 0x7f8e48158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 -- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e480b69b0 msgr2=0x7f8e48150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e480b69b0 0x7f8e48150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 -- 172.21.15.28:0/3294889393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e480cc500 con 0x7f8e480b96d0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e477fe640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 0x7f8e48158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e467fc640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c450 tx=0x7f8e3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c018070 con 0x7f8e480b96d0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0074e0 con 0x7f8e480b96d0 2024-09-15T22:58:11.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e480cc7e0 con 0x7f8e480b96d0 2024-09-15T22:58:11.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0049f0 con 0x7f8e480b96d0 2024-09-15T22:58:11.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e480ccda0 con 0x7f8e480b96d0 2024-09-15T22:58:11.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e48161130 con 0x7f8e480b96d0 2024-09-15T22:58:11.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e3c01b070 con 0x7f8e480b96d0 2024-09-15T22:58:11.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 0x7f8e34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f8e3c085030 con 0x7f8e480b96d0 2024-09-15T22:58:11.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e46ffd640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 0x7f8e34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.188+0000 7f8e46ffd640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 0x7f8e34069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e481540a0 tx=0x7f8e38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.192+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e3c055b30 con 0x7f8e480b96d0 2024-09-15T22:58:11.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.420+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7f8e480b4740 con 0x7f8e480b96d0 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.424+0000 7f8e2ffff640 1 -- 172.21.15.28:0/3294889393 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) ==== 184+0+141 (secure 0 0 0) 0x7f8e3c055430 con 0x7f8e480b96d0 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDVZedmuu3ZGhAACg1I3SAZpQ9m9XPOGdtLFQ== 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2024-09-15T22:58:11.428 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs_data" 2024-09-15T22:58:11.429 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2024-09-15T22:58:11.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 msgr2=0x7f8e34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 0x7f8e34069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e481540a0 tx=0x7f8e38008040 comp rx=0 tx=0).stop 2024-09-15T22:58:11.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 msgr2=0x7f8e4815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c450 tx=0x7f8e3c00c910 comp rx=0 tx=0).stop 2024-09-15T22:58:11.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 shutdown_connections 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8e480d3940 0x7f8e48158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8e480b96d0 0x7f8e4815d650 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8e340678f0 0x7f8e34069db0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 --2- 172.21.15.28:0/3294889393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e480b69b0 0x7f8e48150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 >> 172.21.15.28:0/3294889393 conn(0x7f8e480d1330 msgr2=0x7f8e4806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 shutdown_connections 2024-09-15T22:58:11.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.428+0000 7f8e4d829640 1 -- 172.21.15.28:0/3294889393 wait complete. 2024-09-15T22:58:11.447 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:58:11.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:58:11.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:58:11.603 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:58:11.603 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:58:11.603 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:11.603 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:11.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:58:11.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 Processor -- start 2024-09-15T22:58:11.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 -- start start 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b1815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b180b55e0 con 0x7f9b180cca90 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b180cd020 con 0x7f9b180b5200 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1f4c6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9b180ce3b0 con 0x7f9b180b24d0 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1ca61640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9b180cca90 0x7f9b180b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54376/0 (socket says 172.21.15.28:54376) 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1ca61640 1 -- 172.21.15.28:0/3381085730 learned_addr learned my addr 172.21.15.28:0/3381085730 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:11.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b1da63640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b1815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655979992 0 0) 0x7f9b180b55e0 con 0x7f9b180cca90 2024-09-15T22:58:11.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b08003530 con 0x7f9b180cca90 2024-09-15T22:58:11.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536529776 0 0) 0x7f9b180cd020 con 0x7f9b180b5200 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b180b55e0 con 0x7f9b180b5200 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1094846096 0 0) 0x7f9b08003530 con 0x7f9b180cca90 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 msgr2=0x7f9b1815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b1815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 >> v1:172.21.15.131:6789/0 conn(0x7f9b180b5200 legacy=0x7f9b180b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b180cd300 con 0x7f9b180cca90 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f9b0c001a00 con 0x7f9b180cca90 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 >> v1:172.21.15.28:6789/0 conn(0x7f9b180cca90 legacy=0x7f9b180b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b08003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.780+0000 7f9b17fff640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b08004d50 0x7f9b080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0800bb60 con 0x7f9b08003b80 2024-09-15T22:58:11.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0800bce0 con 0x7f9b08004d50 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0800bee0 con 0x7f9b180b24d0 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b08003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1da63640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b08004d50 0x7f9b080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 -- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 msgr2=0x7f9b08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 -- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b08004d50 msgr2=0x7f9b080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b08004d50 0x7f9b080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 -- 172.21.15.28:0/3381085730 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b08003530 con 0x7f9b08003b80 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1da63640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b08004d50 0x7f9b080051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:11.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b180b24d0 0x7f9b08004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1d262640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b08003f80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9b040018d0 tx=0x7f9b0401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00479d94ba8992d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04001520 con 0x7f9b08003b80 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b040052f0 con 0x7f9b08003b80 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b17fff640 1 -- 172.21.15.28:0/3381085730 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04003840 con 0x7f9b08003b80 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/3381085730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 msgr2=0x7f9b08003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/3381085730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b08003f80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9b040018d0 tx=0x7f9b0401c580 comp rx=0 tx=0).stop 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1da63640 1 -- 172.21.15.28:0/3381085730 reap_dead start 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/3381085730 shutdown_connections 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/3381085730 >> 172.21.15.28:0/3381085730 conn(0x7f9b1806bcc0 msgr2=0x7f9b1806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/3381085730 shutdown_connections 2024-09-15T22:58:11.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.784+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/3381085730 wait complete. 2024-09-15T22:58:11.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 Processor -- start 2024-09-15T22:58:11.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- start start 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 0x7f9b18155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 0x7f9b181511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b180b3ec0 con 0x7f9b08003b80 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b180b3d40 con 0x7f9b181564a0 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9b180b4040 con 0x7f9b18158340 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48608/0 (socket says 172.21.15.28:48608) 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 -- 172.21.15.28:0/2354590991 learned_addr learned my addr 172.21.15.28:0/2354590991 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 0x7f9b18155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1da63640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 0x7f9b181511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 -- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 msgr2=0x7f9b18155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 0x7f9b18155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 -- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 msgr2=0x7f9b181511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 0x7f9b181511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 -- 172.21.15.28:0/2354590991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b18152290 con 0x7f9b08003b80 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 0x7f9b18155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1da63640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 0x7f9b181511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1d262640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9b04000c10 tx=0x7f9b08005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040bc070 con 0x7f9b08003b80 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b040054a0 con 0x7f9b08003b80 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b18151fb0 con 0x7f9b08003b80 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04001500 con 0x7f9b08003b80 2024-09-15T22:58:11.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181509f0 con 0x7f9b08003b80 2024-09-15T22:58:11.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.788+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b180b43d0 con 0x7f9b08003b80 2024-09-15T22:58:11.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.792+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b040bf070 con 0x7f9b08003b80 2024-09-15T22:58:11.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.792+0000 7f9b15ffb640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 0x7f9afc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.792+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f9b0411ee00 con 0x7f9b08003b80 2024-09-15T22:58:11.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.792+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 0x7f9afc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.792+0000 7f9b1ca61640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 0x7f9afc069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c001590 tx=0x7f9b0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.796+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b04016290 con 0x7f9b08003b80 2024-09-15T22:58:11.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.968+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b18156880 con 0x7f9b08003b80 2024-09-15T22:58:11.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.968+0000 7f9b15ffb640 1 -- 172.21.15.28:0/2354590991 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f9b040ef900 con 0x7f9b08003b80 2024-09-15T22:58:11.973 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-09-15T22:58:11.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 msgr2=0x7f9afc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 0x7f9afc069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c001590 tx=0x7f9b0c009040 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 msgr2=0x7f9b1814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9b04000c10 tx=0x7f9b08005840 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 shutdown_connections 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9afc0678c0 0x7f9afc069d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b181564a0 0x7f9b181511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b18158340 0x7f9b18155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 --2- 172.21.15.28:0/2354590991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9b08003b80 0x7f9b1814fa80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 >> 172.21.15.28:0/2354590991 conn(0x7f9b1806bcc0 msgr2=0x7f9b1815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 shutdown_connections 2024-09-15T22:58:11.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:11.972+0000 7f9b1f4c6640 1 -- 172.21.15.28:0/2354590991 wait complete. 2024-09-15T22:58:11.991 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-09-15T22:58:11.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:11.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T22:58:12.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi028.stderr:ceph-fuse[39644]: fuse finished with error 0 and tester_r 0 2024-09-15T22:58:12.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:12.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:12.004 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:58:12.054 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:58:12.055 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:58:12.055 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:12.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:58:12.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:12.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:12.061 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:58:12.114 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T22:58:12.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:12.115 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:58:12.115 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:12.115 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:12.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:58:12.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:12.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:12.120 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T22:58:12.166 INFO:teuthology.orchestra.run.smithi028.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T22:58:12.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:12.167 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:58:12.167 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:58:12.167 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:12.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:58:12.173 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:12.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:12.174 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T22:58:12.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:12.224 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T22:58:12.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:58:12.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 Processor -- start 2024-09-15T22:58:12.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 -- start start 2024-09-15T22:58:12.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 0x7fafe80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafe80aedf0 0x7fafe8161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80b56d0 con 0x7fafe815e3a0 2024-09-15T22:58:12.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fafe80d0840 con 0x7fafe80aedf0 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafef591640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fafe80cf650 con 0x7fafe80b5160 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafedb2e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafe80aedf0 0x7fafe8161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafed32d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fafe815e3a0 0x7fafe80d0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54384/0 (socket says 172.21.15.28:54384) 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafed32d640 1 -- 172.21.15.28:0/3473284624 learned_addr learned my addr 172.21.15.28:0/3473284624 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafecb2c640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 0x7fafe80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafedb2e640 1 -- 172.21.15.28:0/3473284624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 msgr2=0x7fafe80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafedb2e640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 0x7fafe80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafedb2e640 1 -- 172.21.15.28:0/3473284624 >> v1:172.21.15.28:6789/0 conn(0x7fafe815e3a0 legacy=0x7fafe80d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafedb2e640 1 -- 172.21.15.28:0/3473284624 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80cf930 con 0x7fafe80aedf0 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafdffff640 1 -- 172.21.15.28:0/3473284624 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728773095 0 0) 0x7fafe80b56d0 con 0x7fafe815e3a0 2024-09-15T22:58:12.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.348+0000 7fafecb2c640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 0x7fafe80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:12.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafedb2e640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80aedf0 0x7fafe8161f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097c0 tx=0x7fafe001c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38e391ece5a7765 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafdffff640 1 -- 172.21.15.28:0/3473284624 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00b0070 con 0x7fafe80aedf0 2024-09-15T22:58:12.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafdffff640 1 -- 172.21.15.28:0/3473284624 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe00ab600 con 0x7fafe80aedf0 2024-09-15T22:58:12.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafdffff640 1 -- 172.21.15.28:0/3473284624 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00ab9d0 con 0x7fafe80aedf0 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- 172.21.15.28:0/3473284624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80aedf0 msgr2=0x7fafe8161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80aedf0 0x7fafe8161f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097c0 tx=0x7fafe001c120 comp rx=0 tx=0).stop 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- 172.21.15.28:0/3473284624 shutdown_connections 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80aedf0 0x7fafe8161f60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 --2- 172.21.15.28:0/3473284624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe80b5160 0x7fafe80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- 172.21.15.28:0/3473284624 >> 172.21.15.28:0/3473284624 conn(0x7fafe80b0740 msgr2=0x7fafe80b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- 172.21.15.28:0/3473284624 shutdown_connections 2024-09-15T22:58:12.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- 172.21.15.28:0/3473284624 wait complete. 2024-09-15T22:58:12.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 Processor -- start 2024-09-15T22:58:12.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.352+0000 7fafef591640 1 -- start start 2024-09-15T22:58:12.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe80aedf0 0x7fafe8167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe815e3a0 0x7fafe81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafe80cf2b0 con 0x7fafe80b5160 2024-09-15T22:58:12.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fafe80b6ae0 con 0x7fafe80aedf0 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fafe80cf430 con 0x7fafe815e3a0 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48618/0 (socket says 172.21.15.28:48618) 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 -- 172.21.15.28:0/2321250074 learned_addr learned my addr 172.21.15.28:0/2321250074 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafedb2e640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe815e3a0 0x7fafe81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafed32d640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe80aedf0 0x7fafe8167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 -- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe815e3a0 msgr2=0x7fafe81452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe815e3a0 0x7fafe81452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 -- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe80aedf0 msgr2=0x7fafe8167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe80aedf0 0x7fafe8167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 -- 172.21.15.28:0/2321250074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe81583b0 con 0x7fafe80b5160 2024-09-15T22:58:12.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafecb2c640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafd800cf90 tx=0x7fafd800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd801a070 con 0x7fafe80b5160 2024-09-15T22:58:12.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd800d840 con 0x7fafe80b5160 2024-09-15T22:58:12.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe8142fb0 con 0x7fafe80b5160 2024-09-15T22:58:12.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd800dc10 con 0x7fafe80b5160 2024-09-15T22:58:12.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe815b080 con 0x7fafe80b5160 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8161f60 con 0x7fafe80b5160 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fafd801d070 con 0x7fafe80b5160 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafed32d640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fafd80864d0 con 0x7fafe80b5160 2024-09-15T22:58:12.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.356+0000 7fafed32d640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 0x7fafd4069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafe4000f70 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.360+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fafd80568f0 con 0x7fafe80b5160 2024-09-15T22:58:12.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafe80b4a70 con 0x7fafe80b5160 2024-09-15T22:58:12.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafddffb640 1 -- 172.21.15.28:0/2321250074 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7fafd805abf0 con 0x7fafe80b5160 2024-09-15T22:58:12.564 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:12.564 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:58:12.564 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 msgr2=0x7fafd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 0x7fafd4069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafe4000f70 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 msgr2=0x7fafe8167fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafd800cf90 tx=0x7fafd800a7d0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 shutdown_connections 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafe815e3a0 0x7fafe81452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafe80b5160 0x7fafe8167fb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fafd40678c0 0x7fafd4069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 --2- 172.21.15.28:0/2321250074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafe80aedf0 0x7fafe8167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 >> 172.21.15.28:0/2321250074 conn(0x7fafe80b0740 msgr2=0x7fafe80b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:12.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.560+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 shutdown_connections 2024-09-15T22:58:12.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.564+0000 7fafef591640 1 -- 172.21.15.28:0/2321250074 wait complete. 2024-09-15T22:58:12.583 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:58:12.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 Processor -- start 2024-09-15T22:58:12.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 -- start start 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f49840cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49840d0190 0x7f49840cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49840d0960 con 0x7f4984145970 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f49840d0f20 con 0x7f49840d0190 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498c74e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f49840cd620 con 0x7f49840b24d0 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49840d0190 0x7f49840cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49840d0190 0x7f49840cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48622/0 (socket says 172.21.15.28:48622) 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 -- 172.21.15.28:0/4193667274 learned_addr learned my addr 172.21.15.28:0/4193667274 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:12.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f4989ce9640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f49840cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 -- 172.21.15.28:0/4193667274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 msgr2=0x7f49840cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:12.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f49840cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 -- 172.21.15.28:0/4193667274 >> v1:172.21.15.131:6789/0 conn(0x7f4984145970 legacy=0x7f49840b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:12.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.704+0000 7f498aceb640 1 -- 172.21.15.28:0/4193667274 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49840d0c40 con 0x7f49840d0190 2024-09-15T22:58:12.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498aceb640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49840d0190 0x7f49840cdab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c01d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f4c844e7404aca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f49894e8640 1 -- 172.21.15.28:0/4193667274 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0a57d0 con 0x7f49840d0190 2024-09-15T22:58:12.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f49894e8640 1 -- 172.21.15.28:0/4193667274 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c0a5970 con 0x7f49840d0190 2024-09-15T22:58:12.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f49894e8640 1 -- 172.21.15.28:0/4193667274 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0a5d40 con 0x7f49840d0190 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- 172.21.15.28:0/4193667274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49840d0190 msgr2=0x7f49840cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49840d0190 0x7f49840cdab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c01d390 comp rx=0 tx=0).stop 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- 172.21.15.28:0/4193667274 shutdown_connections 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49840d0190 0x7f49840cdab0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- 172.21.15.28:0/4193667274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f49840cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- 172.21.15.28:0/4193667274 >> 172.21.15.28:0/4193667274 conn(0x7f498406bcc0 msgr2=0x7f498406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- 172.21.15.28:0/4193667274 shutdown_connections 2024-09-15T22:58:12.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- 172.21.15.28:0/4193667274 wait complete. 2024-09-15T22:58:12.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 Processor -- start 2024-09-15T22:58:12.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- start start 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f4984140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 0x7f498415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49840ce980 con 0x7f4984145970 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f49840ce800 con 0x7f49840d0190 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498c74e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f49840ceb00 con 0x7f49840b24d0 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498aceb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498aceb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48638/0 (socket says 172.21.15.28:48638) 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.708+0000 7f498aceb640 1 -- 172.21.15.28:0/3039670462 learned_addr learned my addr 172.21.15.28:0/3039670462 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498a4ea640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f4984140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f4989ce9640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 0x7f498415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 -- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 msgr2=0x7f4984140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f4984140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 -- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 msgr2=0x7f498415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 0x7f498415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 -- 172.21.15.28:0/3039670462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49840b40d0 con 0x7f4984145970 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f4989ce9640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 0x7f498415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498aceb640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0bc030 con 0x7f4984145970 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c0b8470 con 0x7f4984145970 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49840b43b0 con 0x7f4984145970 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b8860 con 0x7f4984145970 2024-09-15T22:58:12.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49840b4970 con 0x7f4984145970 2024-09-15T22:58:12.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49840cfc50 con 0x7f4984145970 2024-09-15T22:58:12.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f497c0bf070 con 0x7f4984145970 2024-09-15T22:58:12.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 0x7f4968069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:12.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f497c120930 con 0x7f4984145970 2024-09-15T22:58:12.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498a4ea640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 0x7f4968069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:12.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.712+0000 7f498a4ea640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 0x7f4968069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4974004e30 tx=0x7f4974009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:12.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.716+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f497c0c6070 con 0x7f4984145970 2024-09-15T22:58:12.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49840b0500 con 0x7f4984145970 2024-09-15T22:58:12.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f497affd640 1 -- 172.21.15.28:0/3039670462 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7f497c0165e0 con 0x7f4984145970 2024-09-15T22:58:12.915 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:12.915 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:58:12.915 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 msgr2=0x7f4968069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 0x7f4968069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4974004e30 tx=0x7f4974009040 comp rx=0 tx=0).stop 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 msgr2=0x7f498415bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f497c009e50 tx=0x7f497c0196d0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 shutdown_connections 2024-09-15T22:58:12.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4984145970 0x7f498415bbc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f49680678c0 0x7f4968069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49840d0190 0x7f498415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 --2- 172.21.15.28:0/3039670462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49840b24d0 0x7f4984140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 >> 172.21.15.28:0/3039670462 conn(0x7f498406bcc0 msgr2=0x7f498415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 shutdown_connections 2024-09-15T22:58:12.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:12.912+0000 7f498c74e640 1 -- 172.21.15.28:0/3039670462 wait complete. 2024-09-15T22:58:12.933 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:58:13.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.048+0000 7fb9779e0640 1 Processor -- start 2024-09-15T22:58:13.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.048+0000 7fb9779e0640 1 -- start start 2024-09-15T22:58:13.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb9779e0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9700b5200 0x7fb97015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb9779e0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb9700b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb9779e0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9700b55e0 con 0x7fb9700cca90 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb9779e0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb9700ce3b0 con 0x7fb9700b5200 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb9779e0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb97015c5f0 con 0x7fb9700b1dc0 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb974f7b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb9700cca90 0x7fb9700b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54338/0 (socket says 172.21.15.28:54338) 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb974f7b640 1 -- 172.21.15.28:0/672841510 learned_addr learned my addr 172.21.15.28:0/672841510 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb975f7d640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb9700b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 --2- 172.21.15.28:0/672841510 >> v2:172.21.15.131:3300/0 conn(0x7fb9700b5200 0x7fb97015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070798581 0 0) 0x7fb9700b55e0 con 0x7fb9700cca90 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb95c003530 con 0x7fb9700cca90 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950203832 0 0) 0x7fb95c003530 con 0x7fb9700cca90 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 msgr2=0x7fb9700b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb9700b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 >> v2:172.21.15.131:3300/0 conn(0x7fb9700b5200 msgr2=0x7fb97015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 --2- 172.21.15.28:0/672841510 >> v2:172.21.15.131:3300/0 conn(0x7fb9700b5200 0x7fb97015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9700cd020 con 0x7fb9700cca90 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fb96c001680 con 0x7fb9700cca90 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 >> v1:172.21.15.28:6789/0 conn(0x7fb9700cca90 legacy=0x7fb9700b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb95c0039f0 0x7fb95c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb95c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb95c004d50 0x7fb95c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb97015c5f0 con 0x7fb95c0039f0 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c00b9d0 con 0x7fb95c004d50 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c00bb80 con 0x7fb9700b1dc0 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb95c0039f0 0x7fb95c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb975f7d640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb95c004d50 0x7fb95c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 -- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 msgr2=0x7fb95c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb974f7b640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb95c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb95c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 -- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb95c004d50 msgr2=0x7fb95c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb95c004d50 0x7fb95c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb97577c640 1 -- 172.21.15.28:0/672841510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c003530 con 0x7fb95c0039f0 2024-09-15T22:58:13.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb975f7d640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb95c004d50 0x7fb95c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.052+0000 7fb974f7b640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9700b1dc0 0x7fb95c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb97577c640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb95c0039f0 0x7fb95c003e10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb960009ae0 tx=0x7fb96001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a32f0cc25771f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600b2070 con 0x7fb95c0039f0 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9600a5570 con 0x7fb95c0039f0 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb967fff640 1 -- 172.21.15.28:0/672841510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600096b0 con 0x7fb95c0039f0 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/672841510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb95c0039f0 msgr2=0x7fb95c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 --2- 172.21.15.28:0/672841510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb95c0039f0 0x7fb95c003e10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb960009ae0 tx=0x7fb96001cab0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 -- 172.21.15.28:0/672841510 reap_dead start 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/672841510 shutdown_connections 2024-09-15T22:58:13.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/672841510 >> 172.21.15.28:0/672841510 conn(0x7fb97006bcc0 msgr2=0x7fb97006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/672841510 shutdown_connections 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/672841510 wait complete. 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 Processor -- start 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- start start 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 0x7fb9701401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9700732b0 0x7fb970073730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9700b25e0 con 0x7fb9701634e0 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9700b3d40 con 0x7fb9700732b0 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb970140b80 con 0x7fb95c0039f0 2024-09-15T22:58:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36524/0 (socket says 172.21.15.28:36524) 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 -- 172.21.15.28:0/1371152893 learned_addr learned my addr 172.21.15.28:0/1371152893 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb97577c640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 0x7fb9701401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 -- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 msgr2=0x7fb9701401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 0x7fb9701401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 -- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9700732b0 msgr2=0x7fb970073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9700732b0 0x7fb970073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 -- 172.21.15.28:0/1371152893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb970164210 con 0x7fb9701634e0 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb97577c640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 0x7fb9701401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb975f7d640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb9700741a0 tx=0x7fb96800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96801c070 con 0x7fb9701634e0 2024-09-15T22:58:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb968017400 con 0x7fb9701634e0 2024-09-15T22:58:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9701644f0 con 0x7fb9701634e0 2024-09-15T22:58:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.056+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9680177d0 con 0x7fb9701634e0 2024-09-15T22:58:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb970164ab0 con 0x7fb9701634e0 2024-09-15T22:58:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9700b40d0 con 0x7fb9701634e0 2024-09-15T22:58:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb96801f070 con 0x7fb9701634e0 2024-09-15T22:58:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb965ffb640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 0x7fb954069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fb968085da0 con 0x7fb9701634e0 2024-09-15T22:58:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb97577c640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 0x7fb954069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.060+0000 7fb97577c640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 0x7fb954069db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9600af000 tx=0x7fb9600046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.064+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb968012070 con 0x7fb9701634e0 2024-09-15T22:58:13.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.228+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9700cfd60 con 0x7fb9701634e0 2024-09-15T22:58:13.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.228+0000 7fb965ffb640 1 -- 172.21.15.28:0/1371152893 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16837 (secure 0 0 0) 0x7fb9680568a0 con 0x7fb9701634e0 2024-09-15T22:58:13.234 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:13.234 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":48,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:58:03.297873+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:51.317043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:52.576794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:58:13.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 msgr2=0x7fb954069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 0x7fb954069db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9600af000 tx=0x7fb9600046d0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 msgr2=0x7fb970163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb9700741a0 tx=0x7fb96800f4a0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 shutdown_connections 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9701634e0 0x7fb970163960 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb9540678f0 0x7fb954069db0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9700732b0 0x7fb970073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 --2- 172.21.15.28:0/1371152893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb95c0039f0 0x7fb9701401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 >> 172.21.15.28:0/1371152893 conn(0x7fb97006bcc0 msgr2=0x7fb970157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 shutdown_connections 2024-09-15T22:58:13.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.232+0000 7fb9779e0640 1 -- 172.21.15.28:0/1371152893 wait complete. 2024-09-15T22:58:13.252 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:58:13.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:58:13.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 Processor -- start 2024-09-15T22:58:13.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 -- start start 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b140b24d0 0x7f0b140cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140d0190 0x7f0b140cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140d0960 con 0x7f0b14145970 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0b140d0f20 con 0x7f0b140b24d0 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1c05d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140cd620 con 0x7f0b140d0190 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b140b24d0 0x7f0b140cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b140b24d0 0x7f0b140cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36540/0 (socket says 172.21.15.28:36540) 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 -- 172.21.15.28:0/736596165 learned_addr learned my addr 172.21.15.28:0/736596165 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b1a5fa640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140d0190 0x7f0b140cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 -- 172.21.15.28:0/736596165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140d0190 msgr2=0x7f0b140cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140d0190 0x7f0b140cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 -- 172.21.15.28:0/736596165 >> v1:172.21.15.131:6789/0 conn(0x7f0b14145970 legacy=0x7f0b140b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.376+0000 7f0b195f8640 1 -- 172.21.15.28:0/736596165 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140d0c40 con 0x7f0b140b24d0 2024-09-15T22:58:13.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140b24d0 0x7f0b140cfc50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0b140afd50 tx=0x7f0b0401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf0dbcaa81b39b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b18df7640 1 -- 172.21.15.28:0/736596165 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040b0070 con 0x7f0b140b24d0 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b18df7640 1 -- 172.21.15.28:0/736596165 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b040ab600 con 0x7f0b140b24d0 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b18df7640 1 -- 172.21.15.28:0/736596165 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ab9d0 con 0x7f0b140b24d0 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- 172.21.15.28:0/736596165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140b24d0 msgr2=0x7f0b140cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140b24d0 0x7f0b140cfc50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0b140afd50 tx=0x7f0b0401c420 comp rx=0 tx=0).stop 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- 172.21.15.28:0/736596165 shutdown_connections 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140d0190 0x7f0b140cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/736596165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140b24d0 0x7f0b140cfc50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- 172.21.15.28:0/736596165 >> 172.21.15.28:0/736596165 conn(0x7f0b1406bcc0 msgr2=0x7f0b1406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- 172.21.15.28:0/736596165 shutdown_connections 2024-09-15T22:58:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- 172.21.15.28:0/736596165 wait complete. 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 Processor -- start 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- start start 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 0x7f0b141592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b14145970 0x7f0b141f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140ce980 con 0x7f0b140d0190 2024-09-15T22:58:13.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140ce800 con 0x7f0b14145970 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1c05d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140ceb00 con 0x7f0b140b24d0 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36544/0 (socket says 172.21.15.28:36544) 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 -- 172.21.15.28:0/2156022789 learned_addr learned my addr 172.21.15.28:0/2156022789 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b19df9640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 0x7f0b141592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 -- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 msgr2=0x7f0b141592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b1a5fa640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b14145970 0x7f0b141f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 0x7f0b141592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 -- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b14145970 msgr2=0x7f0b141f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b14145970 0x7f0b141f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b195f8640 1 -- 172.21.15.28:0/2156022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1413cd20 con 0x7f0b140d0190 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.380+0000 7f0b19df9640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 0x7f0b141592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b195f8640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ae040 tx=0x7f0b0401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ba020 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b040b6420 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040b0040 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1415a4e0 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1415aaa0 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1413cef0 con 0x7f0b140d0190 2024-09-15T22:58:13.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b040bd020 con 0x7f0b140d0190 2024-09-15T22:58:13.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 0x7f0af8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f0b0411ff00 con 0x7f0b140d0190 2024-09-15T22:58:13.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b19df9640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 0x7f0af8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.384+0000 7f0b19df9640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 0x7f0af8069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b141f8720 tx=0x7f0b10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.388+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0b040c4030 con 0x7f0b140d0190 2024-09-15T22:58:13.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.588+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b140cfc50 con 0x7f0b140d0190 2024-09-15T22:58:13.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.588+0000 7f0b0a7fc640 1 -- 172.21.15.28:0/2156022789 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7f0b040160d0 con 0x7f0b140d0190 2024-09-15T22:58:13.593 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:13.593 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:58:13.594 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:58:13.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 msgr2=0x7f0af8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 0x7f0af8069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b141f8720 tx=0x7f0b10009040 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 msgr2=0x7f0b14140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ae040 tx=0x7f0b0401ac60 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 shutdown_connections 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f0af80678c0 0x7f0af8069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b14145970 0x7f0b141f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b140d0190 0x7f0b14140bf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 --2- 172.21.15.28:0/2156022789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b140b24d0 0x7f0b141592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 >> 172.21.15.28:0/2156022789 conn(0x7f0b1406bcc0 msgr2=0x7f0b14072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 shutdown_connections 2024-09-15T22:58:13.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.592+0000 7f0b1c05d640 1 -- 172.21.15.28:0/2156022789 wait complete. 2024-09-15T22:58:13.614 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:58:13.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.728+0000 7f5a3f077640 1 Processor -- start 2024-09-15T22:58:13.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.728+0000 7f5a3f077640 1 -- start start 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3f077640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 0x7f5a380cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3f077640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5a380d0190 0x7f5a380cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3f077640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380d0960 con 0x7f5a38145970 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3f077640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5a380d0f20 con 0x7f5a380d0190 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3f077640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5a380cd620 con 0x7f5a380b24d0 2024-09-15T22:58:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5a380d0190 0x7f5a380cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5a380d0190 0x7f5a380cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36554/0 (socket says 172.21.15.28:36554) 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 -- 172.21.15.28:0/677630613 learned_addr learned my addr 172.21.15.28:0/677630613 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a37fff640 1 --2- 172.21.15.28:0/677630613 >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 0x7f5a380cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 -- 172.21.15.28:0/677630613 >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 msgr2=0x7f5a380cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 --2- 172.21.15.28:0/677630613 >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 0x7f5a380cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 -- 172.21.15.28:0/677630613 >> v1:172.21.15.28:6789/0 conn(0x7f5a38145970 legacy=0x7f5a380b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 -- 172.21.15.28:0/677630613 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380d0c40 con 0x7f5a380d0190 2024-09-15T22:58:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a37fff640 1 --2- 172.21.15.28:0/677630613 >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 0x7f5a380cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.732+0000 7f5a3d614640 1 --2- 172.21.15.28:0/677630613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a380cdab0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5a380afd50 tx=0x7f5a3001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1d4db31d3cc8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a377fe640 1 -- 172.21.15.28:0/677630613 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5780 con 0x7f5a380d0190 2024-09-15T22:58:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a377fe640 1 -- 172.21.15.28:0/677630613 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a300a5920 con 0x7f5a380d0190 2024-09-15T22:58:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a377fe640 1 -- 172.21.15.28:0/677630613 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5cf0 con 0x7f5a380d0190 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/677630613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 msgr2=0x7f5a380cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- 172.21.15.28:0/677630613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a380cdab0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5a380afd50 tx=0x7f5a3001c930 comp rx=0 tx=0).stop 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/677630613 shutdown_connections 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- 172.21.15.28:0/677630613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a380cdab0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- 172.21.15.28:0/677630613 >> v2:172.21.15.131:3300/0 conn(0x7f5a380b24d0 0x7f5a380cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/677630613 >> 172.21.15.28:0/677630613 conn(0x7f5a3806bcc0 msgr2=0x7f5a3806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/677630613 shutdown_connections 2024-09-15T22:58:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/677630613 wait complete. 2024-09-15T22:58:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 Processor -- start 2024-09-15T22:58:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- start start 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 0x7f5a3815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 0x7f5a381f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380ce980 con 0x7f5a380d0190 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380ce800 con 0x7f5a380b24d0 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5a380ceb00 con 0x7f5a38145970 2024-09-15T22:58:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36568/0 (socket says 172.21.15.28:36568) 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 -- 172.21.15.28:0/3612961283 learned_addr learned my addr 172.21.15.28:0/3612961283 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3d614640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 0x7f5a381f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3ce13640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 0x7f5a3815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 -- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 msgr2=0x7f5a381f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 0x7f5a381f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 -- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 msgr2=0x7f5a3815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 0x7f5a3815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 -- 172.21.15.28:0/3612961283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381432a0 con 0x7f5a380d0190 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3d614640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 0x7f5a381f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3ce13640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 0x7f5a3815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a37fff640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c7f0 tx=0x7f5a2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c007a30 con 0x7f5a380d0190 2024-09-15T22:58:13.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c007bd0 con 0x7f5a380d0190 2024-09-15T22:58:13.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0113f0 con 0x7f5a380d0190 2024-09-15T22:58:13.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a38143580 con 0x7f5a380d0190 2024-09-15T22:58:13.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.736+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a38143b40 con 0x7f5a380d0190 2024-09-15T22:58:13.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38072280 con 0x7f5a380d0190 2024-09-15T22:58:13.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a2c011590 con 0x7f5a380d0190 2024-09-15T22:58:13.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a357fa640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 0x7f5a24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:13.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5a2c085ed0 con 0x7f5a380d0190 2024-09-15T22:58:13.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a3ce13640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 0x7f5a24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:13.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.740+0000 7f5a3ce13640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 0x7f5a24069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a3815f8e0 tx=0x7f5a28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:13.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.744+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a2c015020 con 0x7f5a380d0190 2024-09-15T22:58:13.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.940+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a3806c240 con 0x7f5a380d0190 2024-09-15T22:58:13.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a357fa640 1 -- 172.21.15.28:0/3612961283 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7f5a2c0569d0 con 0x7f5a380d0190 2024-09-15T22:58:13.947 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:13.947 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"btime":"2024-09-15T22:57:57:263222+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:57:53.585986+0000","modified":"2024-09-15T22:57:56.622901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/4207620885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":4207620885},{"type":"v1","addr":"172.21.15.28:6837","nonce":4207620885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5250,"qdb_cluster":[5250]},"id":3}]} 2024-09-15T22:58:13.947 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 26 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 msgr2=0x7f5a24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 0x7f5a24069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a3815f8e0 tx=0x7f5a28009040 comp rx=0 tx=0).stop 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 msgr2=0x7f5a3815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c7f0 tx=0x7f5a2c00ccb0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 shutdown_connections 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a38145970 0x7f5a381f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a380d0190 0x7f5a3815d080 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f5a240678c0 0x7f5a24069d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 --2- 172.21.15.28:0/3612961283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a380b24d0 0x7f5a3815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:13.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 >> 172.21.15.28:0/3612961283 conn(0x7f5a3806bcc0 msgr2=0x7f5a380b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:13.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 shutdown_connections 2024-09-15T22:58:13.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:13.944+0000 7f5a3f077640 1 -- 172.21.15.28:0/3612961283 wait complete. 2024-09-15T22:58:13.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:58:14.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 Processor -- start 2024-09-15T22:58:14.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 -- start start 2024-09-15T22:58:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f529006d870 0x7f529006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52900d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529006e190 con 0x7f529015e820 2024-09-15T22:58:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f52900d2ba0 con 0x7f529006d870 2024-09-15T22:58:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f529598f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f52900d2e80 con 0x7f52900b3610 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f528e7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f529015e820 0x7f52900cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54352/0 (socket says 172.21.15.28:54352) 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f528e7fc640 1 -- 172.21.15.28:0/100902564 learned_addr learned my addr 172.21.15.28:0/100902564 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f528effd640 1 --2- 172.21.15.28:0/100902564 >> v2:172.21.15.131:3300/0 conn(0x7f529006d870 0x7f529006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f528f7fe640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52900d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.088+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891506852 0 0) 0x7f529006e190 con 0x7f529015e820 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5270003530 con 0x7f529015e820 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3039967881 0 0) 0x7f5270003530 con 0x7f529015e820 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 msgr2=0x7f52900d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52900d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 >> v2:172.21.15.131:3300/0 conn(0x7f529006d870 msgr2=0x7f529006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 --2- 172.21.15.28:0/100902564 >> v2:172.21.15.131:3300/0 conn(0x7f529006d870 0x7f529006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900d3160 con 0x7f529015e820 2024-09-15T22:58:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f5278001680 con 0x7f529015e820 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 >> v1:172.21.15.28:6789/0 conn(0x7f529015e820 legacy=0x7f52900cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52700039c0 0x7f5270003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5270004810 0x7f5270004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52900d2ba0 con 0x7f52700039c0 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f52900d2e80 con 0x7f5270004810 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f527000b9d0 con 0x7f52900b3610 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52700039c0 0x7f5270003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528e7fc640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5270004810 0x7f5270004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528f7fe640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 -- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 msgr2=0x7f52700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52900b3610 0x7f52700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 -- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5270004810 msgr2=0x7f5270004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5270004810 0x7f5270004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 -- 172.21.15.28:0/100902564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5270003530 con 0x7f52700039c0 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528effd640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52700039c0 0x7f5270003de0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f528001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95d3fee2caf064e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800b2070 con 0x7f52700039c0 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800a5bc0 con 0x7f52700039c0 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528dffb640 1 -- 172.21.15.28:0/100902564 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280009c10 con 0x7f52700039c0 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 -- 172.21.15.28:0/100902564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52700039c0 msgr2=0x7f5270003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 --2- 172.21.15.28:0/100902564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52700039c0 0x7f5270003de0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f528001cc90 comp rx=0 tx=0).stop 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f528f7fe640 1 -- 172.21.15.28:0/100902564 reap_dead start 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 -- 172.21.15.28:0/100902564 shutdown_connections 2024-09-15T22:58:14.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 -- 172.21.15.28:0/100902564 >> 172.21.15.28:0/100902564 conn(0x7f52900d4910 msgr2=0x7f52900d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:14.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 -- 172.21.15.28:0/100902564 shutdown_connections 2024-09-15T22:58:14.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.092+0000 7f529598f640 1 -- 172.21.15.28:0/100902564 wait complete. 2024-09-15T22:58:14.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 Processor -- start 2024-09-15T22:58:14.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- start start 2024-09-15T22:58:14.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52700039c0 0x7f52900c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52900c80f0 0x7f52901499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52900b7ad0 con 0x7f52900cd480 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f52900b7950 con 0x7f52900c80f0 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f52900b7c50 con 0x7f52700039c0 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36582/0 (socket says 172.21.15.28:36582) 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 -- 172.21.15.28:0/1344152202 learned_addr learned my addr 172.21.15.28:0/1344152202 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528effd640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52700039c0 0x7f52900c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528e7fc640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52900c80f0 0x7f52901499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 -- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52700039c0 msgr2=0x7f52900c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52700039c0 0x7f52900c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 -- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52900c80f0 msgr2=0x7f52901499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52900c80f0 0x7f52901499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 -- 172.21.15.28:0/1344152202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900c8580 con 0x7f52900cd480 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f528f7fe640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f52900d00b0 tx=0x7f5288011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288003620 con 0x7f52900cd480 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528801b070 con 0x7f52900cd480 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52900c8860 con 0x7f52900cd480 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288003a40 con 0x7f52900cd480 2024-09-15T22:58:14.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.096+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52900c8e20 con 0x7f52900cd480 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52900b9100 con 0x7f52900cd480 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5288003be0 con 0x7f52900cd480 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f5287fff640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 0x7f5274069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f52880860b0 con 0x7f52900cd480 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f528effd640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 0x7f5274069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.100+0000 7f528effd640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 0x7f5274069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52800af000 tx=0x7f52800a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.104+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5288056bb0 con 0x7f52900cd480 2024-09-15T22:58:14.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.268+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52900c7dd0 con 0x7f52900cd480 2024-09-15T22:58:14.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.268+0000 7f5287fff640 1 -- 172.21.15.28:0/1344152202 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16837 (secure 0 0 0) 0x7f52880564b0 con 0x7f52900cd480 2024-09-15T22:58:14.273 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:14.273 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":48,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:58:03.297873+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:57:51.317043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:57:52.576794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 msgr2=0x7f5274069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 0x7f5274069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52800af000 tx=0x7f52800a7040 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 msgr2=0x7f52900cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f52900d00b0 tx=0x7f5288011920 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 shutdown_connections 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f52900cd480 0x7f52900cd900 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f52740678c0 0x7f5274069d80 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52800af000 tx=0x7f52800a7040 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52900c80f0 0x7f52901499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 --2- 172.21.15.28:0/1344152202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52700039c0 0x7f52900c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 >> 172.21.15.28:0/1344152202 conn(0x7f52900d4910 msgr2=0x7f529006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 shutdown_connections 2024-09-15T22:58:14.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.272+0000 7f529598f640 1 -- 172.21.15.28:0/1344152202 wait complete. 2024-09-15T22:58:14.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:58:14.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 Processor -- start 2024-09-15T22:58:14.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 -- start start 2024-09-15T22:58:14.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f34100b5200 0x7f341015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f34100b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34100b55e0 con 0x7f34100cca90 2024-09-15T22:58:14.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f34100ce3b0 con 0x7f34100b5200 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3416ea9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f341015c5f0 con 0x7f34100b1dc0 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f34100cca90 0x7f34100b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54362/0 (socket says 172.21.15.28:54362) 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340ffff640 1 -- 172.21.15.28:0/2844954916 learned_addr learned my addr 172.21.15.28:0/2844954916 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297445563 0 0) 0x7f34100b55e0 con 0x7f34100cca90 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f8005740 con 0x7f34100cca90 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3414c45640 1 --2- 172.21.15.28:0/2844954916 >> v2:172.21.15.131:3300/0 conn(0x7f34100b5200 0x7f341015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f34100b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1326063073 0 0) 0x7f33f8005740 con 0x7f34100cca90 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 msgr2=0x7f34100b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f34100b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 >> v2:172.21.15.131:3300/0 conn(0x7f34100b5200 msgr2=0x7f341015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 --2- 172.21.15.28:0/2844954916 >> v2:172.21.15.131:3300/0 conn(0x7f34100b5200 0x7f341015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34100cd020 con 0x7f34100cca90 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f3404001680 con 0x7f34100cca90 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f34100b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 >> v1:172.21.15.28:6789/0 conn(0x7f34100cca90 legacy=0x7f34100b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33f8005c00 0x7f33f8006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f33f8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33f8006f60 0x7f33f80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f341015c5f0 con 0x7f33f8006f60 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f33f800dbe0 con 0x7f33f8005c00 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f33f800dde0 con 0x7f34100b1dc0 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33f8006f60 0x7f33f80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3414c45640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33f8005c00 0x7f33f8006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f340ffff640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f33f8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 -- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 msgr2=0x7f33f8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34100b1dc0 0x7f33f8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 -- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33f8005c00 msgr2=0x7f33f8006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33f8005c00 0x7f33f8006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.412+0000 7f3415446640 1 -- 172.21.15.28:0/2844954916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f8005740 con 0x7f33f8006f60 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3415446640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33f8006f60 0x7f33f80073e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f34080073e0 tx=0x7f340801cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e93fbcdf0b8da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080b2070 con 0x7f33f8006f60 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080a5cb0 con 0x7f33f8006f60 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f340f7fe640 1 -- 172.21.15.28:0/2844954916 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408009c80 con 0x7f33f8006f60 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- 172.21.15.28:0/2844954916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33f8006f60 msgr2=0x7f33f80073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 --2- 172.21.15.28:0/2844954916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33f8006f60 0x7f33f80073e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f34080073e0 tx=0x7f340801cec0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3415446640 1 -- 172.21.15.28:0/2844954916 reap_dead start 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- 172.21.15.28:0/2844954916 shutdown_connections 2024-09-15T22:58:14.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- 172.21.15.28:0/2844954916 >> 172.21.15.28:0/2844954916 conn(0x7f341006bcc0 msgr2=0x7f341006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- 172.21.15.28:0/2844954916 shutdown_connections 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- 172.21.15.28:0/2844954916 wait complete. 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 Processor -- start 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.416+0000 7f3416ea9640 1 -- start start 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33f8006f60 0x7f341014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 0x7f3410158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f34100cd8c0 con 0x7f34100ae8b0 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f34100cd5e0 con 0x7f3410158a90 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f34100b21f0 con 0x7f33f8006f60 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36602/0 (socket says 172.21.15.28:36602) 2024-09-15T22:58:14.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 -- 172.21.15.28:0/1289443367 learned_addr learned my addr 172.21.15.28:0/1289443367 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3414c45640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33f8006f60 0x7f341014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340ffff640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 0x7f3410158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 -- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33f8006f60 msgr2=0x7f341014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33f8006f60 0x7f341014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 -- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 msgr2=0x7f3410158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 0x7f3410158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 -- 172.21.15.28:0/1289443367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34101566e0 con 0x7f34100ae8b0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340ffff640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 0x7f3410158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3415446640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f34080073e0 tx=0x7f33f8007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080b2040 con 0x7f34100ae8b0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080a5ab0 con 0x7f34100ae8b0 2024-09-15T22:58:14.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3410151200 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080a5e60 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3410156950 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3410159450 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34080c0400 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 0x7f33fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f34080bd070 con 0x7f34100ae8b0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3414c45640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 0x7f33fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.420+0000 7f3414c45640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 0x7f33fc069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3410153070 tx=0x7f3400008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.424+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3410151200 con 0x7f34100ae8b0 2024-09-15T22:58:14.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.624+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f34100b25b0 con 0x7f34100ae8b0 2024-09-15T22:58:14.629 INFO:tasks.ceph.mon.a.smithi028.stderr:2024-09-15T22:58:14.624+0000 7f45fbb49640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:58:14.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.628+0000 7f340d7fa640 1 -- 172.21.15.28:0/1289443367 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f3408016bd0 con 0x7f34100ae8b0 2024-09-15T22:58:14.632 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:58:14.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.632+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 msgr2=0x7f33fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.632+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 0x7f33fc069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3410153070 tx=0x7f3400008040 comp rx=0 tx=0).stop 2024-09-15T22:58:14.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.632+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 msgr2=0x7f34100aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.632+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f34080073e0 tx=0x7f33f8007a50 comp rx=0 tx=0).stop 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 shutdown_connections 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f34100ae8b0 0x7f34100aed60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f33fc0678c0 0x7f33fc069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3410158a90 0x7f3410158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 --2- 172.21.15.28:0/1289443367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33f8006f60 0x7f341014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 >> 172.21.15.28:0/1289443367 conn(0x7f341006bcc0 msgr2=0x7f341015b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:14.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 shutdown_connections 2024-09-15T22:58:14.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.636+0000 7f3416ea9640 1 -- 172.21.15.28:0/1289443367 wait complete. 2024-09-15T22:58:14.641 INFO:tasks.ceph.mds.a.smithi028.stderr: -2616> 2024-09-15T22:57:56.196+0000 7f1a9d7c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:58:14.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:58:14.682 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2024-09-15T22:58:14.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 Processor -- start 2024-09-15T22:58:14.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 -- start start 2024-09-15T22:58:14.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd4540b2540 0x7fd454162120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4540afbc0 con 0x7fd45415e650 2024-09-15T22:58:14.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd454163050 con 0x7fd4540b31a0 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45c566640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540cdda0 con 0x7fd4540b2540 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45a302640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd45415e650 0x7fd4540b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54380/0 (socket says 172.21.15.28:54380) 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd45a302640 1 -- 172.21.15.28:0/3912781544 learned_addr learned my addr 172.21.15.28:0/3912781544 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459b01640 1 --2- 172.21.15.28:0/3912781544 >> v2:172.21.15.131:3300/0 conn(0x7fd4540b2540 0x7fd454162120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115006869 0 0) 0x7fd4540afbc0 con 0x7fd45415e650 2024-09-15T22:58:14.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c003530 con 0x7fd45415e650 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3159759157 0 0) 0x7fd43c003530 con 0x7fd45415e650 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 >> v2:172.21.15.131:3300/0 conn(0x7fd4540b2540 msgr2=0x7fd454162120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 --2- 172.21.15.28:0/3912781544 >> v2:172.21.15.131:3300/0 conn(0x7fd4540b2540 0x7fd454162120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 >> v1:172.21.15.131:6789/0 conn(0x7fd4540b31a0 legacy=0x7fd4540ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541627b0 con 0x7fd45415e650 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.772+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd44c001a20 con 0x7fd45415e650 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 >> v1:172.21.15.28:6789/0 conn(0x7fd45415e650 legacy=0x7fd4540b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 0x7fd43c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c004810 0x7fd43c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd43c0051d0 0x7fd43c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c00c040 con 0x7fd43c0039c0 2024-09-15T22:58:14.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c00c1f0 con 0x7fd43c004810 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c00c3f0 con 0x7fd43c0051d0 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 0x7fd43c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459b01640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c004810 0x7fd43c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45ab03640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd43c0051d0 0x7fd43c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 -- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd43c0051d0 msgr2=0x7fd43c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd43c0051d0 0x7fd43c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 -- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c004810 msgr2=0x7fd43c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c004810 0x7fd43c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 -- 172.21.15.28:0/3912781544 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c003530 con 0x7fd43c0039c0 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45ab03640 1 -- 172.21.15.28:0/3912781544 reap_dead start 2024-09-15T22:58:14.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459b01640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c004810 0x7fd43c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45a302640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 0x7fd43c003de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00a850 tx=0x7fd44c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c80f32b59b7449e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00a4a0 con 0x7fd43c0039c0 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c0ad630 con 0x7fd43c0039c0 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd459300640 1 -- 172.21.15.28:0/3912781544 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0ada40 con 0x7fd43c0039c0 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 -- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 msgr2=0x7fd43c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 0x7fd43c003de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00a850 tx=0x7fd44c01d360 comp rx=0 tx=0).stop 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 -- 172.21.15.28:0/3912781544 shutdown_connections 2024-09-15T22:58:14.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 --2- 172.21.15.28:0/3912781544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd43c0039c0 0x7fd43c003de0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 -- 172.21.15.28:0/3912781544 >> 172.21.15.28:0/3912781544 conn(0x7fd45406bcc0 msgr2=0x7fd45406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:14.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 -- 172.21.15.28:0/3912781544 shutdown_connections 2024-09-15T22:58:14.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.776+0000 7fd45c566640 1 -- 172.21.15.28:0/3912781544 wait complete. 2024-09-15T22:58:14.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 Processor -- start 2024-09-15T22:58:14.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- start start 2024-09-15T22:58:14.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c0039c0 0x7fd4541558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4541e9f90 0x7fd454072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540cff70 con 0x7fd454156900 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd454162530 con 0x7fd43c0039c0 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540ced00 con 0x7fd4541e9f90 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36636/0 (socket says 172.21.15.28:36636) 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 -- 172.21.15.28:0/4173983065 learned_addr learned my addr 172.21.15.28:0/4173983065 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd459b01640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4541e9f90 0x7fd454072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45a302640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c0039c0 0x7fd4541558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 -- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4541e9f90 msgr2=0x7fd454072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4541e9f90 0x7fd454072a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 -- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c0039c0 msgr2=0x7fd4541558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:14.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c0039c0 0x7fd4541558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:14.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 -- 172.21.15.28:0/4173983065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd454155e30 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45ab03640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd454070e90 tx=0x7fd44400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444018070 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444003600 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4440039f0 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541ea500 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541eaac0 con 0x7fd454156900 2024-09-15T22:58:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.780+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd454069220 con 0x7fd454156900 2024-09-15T22:58:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.784+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd44401b070 con 0x7fd454156900 2024-09-15T22:58:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.784+0000 7fd452ffd640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.784+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7fd444085680 con 0x7fd454156900 2024-09-15T22:58:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.784+0000 7fd45a302640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.784+0000 7fd45a302640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 0x7fd440069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0ad000 tx=0x7fd44c0af040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:14.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.788+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd444022020 con 0x7fd454156900 2024-09-15T22:58:14.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:14.980+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd4540b0e40 con 0x7fd454156900 2024-09-15T22:58:15.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:15.171 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:15.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd452ffd640 1 -- 172.21.15.28:0/4173983065 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fd444056110 con 0x7fd454156900 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 msgr2=0x7fd440069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 0x7fd440069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0ad000 tx=0x7fd44c0af040 comp rx=0 tx=0).stop 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 msgr2=0x7fd454156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd454070e90 tx=0x7fd44400d890 comp rx=0 tx=0).stop 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 shutdown_connections 2024-09-15T22:58:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454156900 0x7fd454156d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4541e9f90 0x7fd454072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.632+0000 7fd45c566640 1 --2- 172.21.15.28:0/4173983065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd43c0039c0 0x7fd4541558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.636+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 >> 172.21.15.28:0/4173983065 conn(0x7fd45406bcc0 msgr2=0x7fd4540afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.636+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 shutdown_connections 2024-09-15T22:58:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.636+0000 7fd45c566640 1 -- 172.21.15.28:0/4173983065 wait complete. 2024-09-15T22:58:15.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:58:15.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.788+0000 7f5949ab4640 1 Processor -- start 2024-09-15T22:58:15.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.788+0000 7f5949ab4640 1 -- start start 2024-09-15T22:58:15.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5949ab4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f594415e810 0x7f59440cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5949ab4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59440d1f60 con 0x7f59440d46c0 2024-09-15T22:58:15.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5949ab4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59440cf490 con 0x7f59440b8be0 2024-09-15T22:58:15.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5949ab4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f594415ebf0 con 0x7f594415e810 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5942ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f59440d46c0 0x7f59440d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54382/0 (socket says 172.21.15.28:54382) 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5942ffd640 1 -- 172.21.15.28:0/4158022783 learned_addr learned my addr 172.21.15.28:0/4158022783 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233818033 0 0) 0x7f59440d1f60 con 0x7f59440d46c0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592c003530 con 0x7f59440d46c0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 --2- 172.21.15.28:0/4158022783 >> v2:172.21.15.131:3300/0 conn(0x7f594415e810 0x7f59440cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765166934 0 0) 0x7f592c003530 con 0x7f59440d46c0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 >> v2:172.21.15.131:3300/0 conn(0x7f594415e810 msgr2=0x7f59440cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 --2- 172.21.15.28:0/4158022783 >> v2:172.21.15.131:3300/0 conn(0x7f594415e810 0x7f59440cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 >> v1:172.21.15.131:6789/0 conn(0x7f59440b8be0 legacy=0x7f59440d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59440cf1b0 con 0x7f59440d46c0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f5938001680 con 0x7f59440d46c0 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 >> v1:172.21.15.28:6789/0 conn(0x7f59440d46c0 legacy=0x7f59440d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f592c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f592c004810 0x7f592c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f592c0051d0 0x7f592c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f594415ebf0 con 0x7f592c0039c0 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f592c00c070 con 0x7f592c004810 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f592c00c270 con 0x7f592c0051d0 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f592c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 -- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f592c0051d0 msgr2=0x7f592c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5943fff640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f592c0051d0 0x7f592c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5942ffd640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f592c004810 0x7f592c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f592c0051d0 0x7f592c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 -- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f592c004810 msgr2=0x7f592c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f592c004810 0x7f592c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f5943fff640 1 -- 172.21.15.28:0/4158022783 reap_dead start 2024-09-15T22:58:15.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 -- 172.21.15.28:0/4158022783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c003530 con 0x7f592c0039c0 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.792+0000 7f59437fe640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f592c003de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5934009ac0 tx=0x7f593401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0f7505595d7ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934009690 con 0x7f592c0039c0 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59340a8460 con 0x7f592c0039c0 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59427fc640 1 -- 172.21.15.28:0/4158022783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340a8830 con 0x7f592c0039c0 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 msgr2=0x7f592c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f592c003de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5934009ac0 tx=0x7f593401ca70 comp rx=0 tx=0).stop 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/4158022783 shutdown_connections 2024-09-15T22:58:15.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 --2- 172.21.15.28:0/4158022783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f592c003de0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/4158022783 >> 172.21.15.28:0/4158022783 conn(0x7f59440b6280 msgr2=0x7f59440b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/4158022783 shutdown_connections 2024-09-15T22:58:15.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/4158022783 wait complete. 2024-09-15T22:58:15.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 Processor -- start 2024-09-15T22:58:15.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- start start 2024-09-15T22:58:15.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5944152630 0x7f594415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 0x7f594415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59440d4eb0 con 0x7f592c0039c0 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59440d3400 con 0x7f5944152630 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59440d5030 con 0x7f59440ca430 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36652/0 (socket says 172.21.15.28:36652) 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 -- 172.21.15.28:0/663409023 learned_addr learned my addr 172.21.15.28:0/663409023 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5942ffd640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5944152630 0x7f594415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5943fff640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 0x7f594415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 -- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 msgr2=0x7f594415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 0x7f594415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 -- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5944152630 msgr2=0x7f594415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5944152630 0x7f594415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 -- 172.21.15.28:0/663409023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59440c96b0 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5943fff640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 0x7f594415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f59437fe640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f593401c8a0 tx=0x7f5934019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340bf070 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59340a9ca0 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59440c9950 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340ba620 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.796+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59440c9f10 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59340c2070 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59440d1140 con 0x7f592c0039c0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f592bfff640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 0x7f5930069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f5942ffd640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 0x7f5930069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7f5934120030 con 0x7f592c0039c0 2024-09-15T22:58:15.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.800+0000 7f5942ffd640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 0x7f5930069db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f59440b9970 tx=0x7f5938009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.804+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59340b5070 con 0x7f592c0039c0 2024-09-15T22:58:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:15.960+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f59440d3ae0 con 0x7f592c0039c0 2024-09-15T22:58:16.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.640+0000 7f592bfff640 1 -- 172.21.15.28:0/663409023 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f59340ac030 con 0x7f592c0039c0 2024-09-15T22:58:16.644 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:58:16.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 msgr2=0x7f5930069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:16.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 0x7f5930069db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f59440b9970 tx=0x7f5938009040 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 msgr2=0x7f5944161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f593401c8a0 tx=0x7f5934019810 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 shutdown_connections 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59440ca430 0x7f594415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f59300678f0 0x7f5930069db0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5944152630 0x7f594415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 --2- 172.21.15.28:0/663409023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f592c0039c0 0x7f5944161820 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 >> 172.21.15.28:0/663409023 conn(0x7f59440b6280 msgr2=0x7f59441edb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:16.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 shutdown_connections 2024-09-15T22:58:16.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.644+0000 7f5949ab4640 1 -- 172.21.15.28:0/663409023 wait complete. 2024-09-15T22:58:16.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:58:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.796+0000 7f538abae640 1 Processor -- start 2024-09-15T22:58:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.796+0000 7f538abae640 1 -- start start 2024-09-15T22:58:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5384155a40 0x7f53840b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f538415b8d0 0x7f53840d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53840d0560 0x7f538406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f53840d09d0 con 0x7f5384155a40 2024-09-15T22:58:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f53840ce1a0 con 0x7f538415b8d0 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f538415c0c0 con 0x7f53840d0560 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5384155a40 0x7f53840b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5384155a40 0x7f53840b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36668/0 (socket says 172.21.15.28:36668) 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 -- 172.21.15.28:0/1887617099 learned_addr learned my addr 172.21.15.28:0/1887617099 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 -- 172.21.15.28:0/1887617099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53840d0560 msgr2=0x7f538406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 --2- 172.21.15.28:0/1887617099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53840d0560 0x7f538406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 -- 172.21.15.28:0/1887617099 >> v2:172.21.15.131:3300/0 conn(0x7f538415b8d0 msgr2=0x7f53840d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 --2- 172.21.15.28:0/1887617099 >> v2:172.21.15.131:3300/0 conn(0x7f538415b8d0 0x7f53840d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 -- 172.21.15.28:0/1887617099 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538415c3a0 con 0x7f5384155a40 2024-09-15T22:58:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538894a640 1 --2- 172.21.15.28:0/1887617099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f53840b3480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53840b5380 tx=0x7f537401e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b710bbca7e023 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f53837fe640 1 -- 172.21.15.28:0/1887617099 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740b4070 con 0x7f5384155a40 2024-09-15T22:58:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f53837fe640 1 -- 172.21.15.28:0/1887617099 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53740a77c0 con 0x7f5384155a40 2024-09-15T22:58:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f53837fe640 1 -- 172.21.15.28:0/1887617099 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740a7b90 con 0x7f5384155a40 2024-09-15T22:58:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- 172.21.15.28:0/1887617099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 msgr2=0x7f53840b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- 172.21.15.28:0/1887617099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f53840b3480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53840b5380 tx=0x7f537401e930 comp rx=0 tx=0).stop 2024-09-15T22:58:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- 172.21.15.28:0/1887617099 shutdown_connections 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- 172.21.15.28:0/1887617099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53840d0560 0x7f538406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- 172.21.15.28:0/1887617099 >> v2:172.21.15.131:3300/0 conn(0x7f538415b8d0 0x7f53840d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 --2- 172.21.15.28:0/1887617099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f53840b3480 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.800+0000 7f538abae640 1 -- 172.21.15.28:0/1887617099 >> 172.21.15.28:0/1887617099 conn(0x7f538406bcc0 msgr2=0x7f538406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- 172.21.15.28:0/1887617099 shutdown_connections 2024-09-15T22:58:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- 172.21.15.28:0/1887617099 wait complete. 2024-09-15T22:58:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 Processor -- start 2024-09-15T22:58:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- start start 2024-09-15T22:58:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 0x7f5384148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538415b8d0 0x7f53841480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53840ccea0 con 0x7f5384155a40 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53840ccd20 con 0x7f53840d0560 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53840cd020 con 0x7f538415b8d0 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36682/0 (socket says 172.21.15.28:36682) 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 -- 172.21.15.28:0/3580846974 learned_addr learned my addr 172.21.15.28:0/3580846974 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538894a640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 0x7f5384148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538914b640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538415b8d0 0x7f53841480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 -- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538415b8d0 msgr2=0x7f53841480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538415b8d0 0x7f53841480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 -- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 msgr2=0x7f5384148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 0x7f5384148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 -- 172.21.15.28:0/3580846974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5384143290 con 0x7f5384155a40 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538894a640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 0x7f5384148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f5383fff640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f537800b410 tx=0x7f537800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378015020 con 0x7f5384155a40 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378011830 con 0x7f5384155a40 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5384144790 con 0x7f5384155a40 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378011c20 con 0x7f5384155a40 2024-09-15T22:58:16.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5384144d50 con 0x7f5384155a40 2024-09-15T22:58:16.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.804+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5384069220 con 0x7f5384155a40 2024-09-15T22:58:16.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.808+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5378018020 con 0x7f5384155a40 2024-09-15T22:58:16.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.808+0000 7f53817fa640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 0x7f5370069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:16.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.808+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5415+0+0 (secure 0 0 0) 0x7f53780859e0 con 0x7f5384155a40 2024-09-15T22:58:16.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.808+0000 7f538894a640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 0x7f5370069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:16.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.808+0000 7f538894a640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 0x7f5370069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f53740b1000 tx=0x7f53740a9070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:16.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.812+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f537801f020 con 0x7f5384155a40 2024-09-15T22:58:16.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:16.976+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53840b3480 con 0x7f5384155a40 2024-09-15T22:58:17.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.648+0000 7f53817fa640 1 -- 172.21.15.28:0/3580846974 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f53780172c0 con 0x7f5384155a40 2024-09-15T22:58:17.653 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-09-15T22:58:17.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 msgr2=0x7f5370069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 0x7f5370069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f53740b1000 tx=0x7f53740a9070 comp rx=0 tx=0).stop 2024-09-15T22:58:17.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 msgr2=0x7f5384147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f537800b410 tx=0x7f537800b8d0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 shutdown_connections 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f538415b8d0 0x7f53841480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5384155a40 0x7f5384147b70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f53700678c0 0x7f5370069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 --2- 172.21.15.28:0/3580846974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53840d0560 0x7f5384148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 >> 172.21.15.28:0/3580846974 conn(0x7f538406bcc0 msgr2=0x7f53840b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 shutdown_connections 2024-09-15T22:58:17.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.652+0000 7f538abae640 1 -- 172.21.15.28:0/3580846974 wait complete. 2024-09-15T22:58:17.684 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:58:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 Processor -- start 2024-09-15T22:58:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 -- start start 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fab6c15ea00 0x7fab6c0b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6c0b3ae0 con 0x7fab6c0d2830 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6c0d2cc0 con 0x7fab6c15e620 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.804+0000 7fab70b9a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c0d2fa0 con 0x7fab6c15ea00 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6ad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fab6c0d2830 0x7fab6c0d4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54390/0 (socket says 172.21.15.28:54390) 2024-09-15T22:58:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6ad9d640 1 -- 172.21.15.28:0/4027884335 learned_addr learned my addr 172.21.15.28:0/4027884335 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 --2- 172.21.15.28:0/4027884335 >> v2:172.21.15.131:3300/0 conn(0x7fab6c15ea00 0x7fab6c0b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850587353 0 0) 0x7fab6c0b3ae0 con 0x7fab6c0d2830 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab54003530 con 0x7fab6c0d2830 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1470771517 0 0) 0x7fab54003530 con 0x7fab6c0d2830 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 >> v2:172.21.15.131:3300/0 conn(0x7fab6c15ea00 msgr2=0x7fab6c0b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 --2- 172.21.15.28:0/4027884335 >> v2:172.21.15.131:3300/0 conn(0x7fab6c15ea00 0x7fab6c0b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 >> v1:172.21.15.131:6789/0 conn(0x7fab6c15e620 legacy=0x7fab6c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0d3280 con 0x7fab6c0d2830 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fab64001680 con 0x7fab6c0d2830 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 >> v1:172.21.15.28:6789/0 conn(0x7fab6c0d2830 legacy=0x7fab6c0d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0d2fa0 con 0x7fab54004810 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400c070 con 0x7fab540039c0 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fab5400c270 con 0x7fab540051d0 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6a59c640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6ad9d640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 -- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab540051d0 msgr2=0x7fab5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 -- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab540039c0 msgr2=0x7fab54003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab69d9b640 1 -- 172.21.15.28:0/4027884335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab54003530 con 0x7fab54004810 2024-09-15T22:58:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.808+0000 7fab6ad9d640 1 -- 172.21.15.28:0/4027884335 reap_dead start 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 0x7fab54004c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fab60009ae0 tx=0x7fab6001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db107069bc4a2dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600b2070 con 0x7fab54004810 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab600a5680 con 0x7fab54004810 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab6959a640 1 -- 172.21.15.28:0/4027884335 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600096b0 con 0x7fab54004810 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 msgr2=0x7fab54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 0x7fab54004c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fab60009ae0 tx=0x7fab6001ca90 comp rx=0 tx=0).stop 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- 172.21.15.28:0/4027884335 shutdown_connections 2024-09-15T22:58:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 --2- 172.21.15.28:0/4027884335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- 172.21.15.28:0/4027884335 >> 172.21.15.28:0/4027884335 conn(0x7fab6c067e00 msgr2=0x7fab6c068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- 172.21.15.28:0/4027884335 shutdown_connections 2024-09-15T22:58:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- 172.21.15.28:0/4027884335 wait complete. 2024-09-15T22:58:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 Processor -- start 2024-09-15T22:58:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- start start 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab54004810 0x7fab6c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab6c153c50 0x7fab6c15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0b3550 con 0x7fab6c154890 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0b33d0 con 0x7fab54004810 2024-09-15T22:58:17.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab70b9a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c0b36d0 con 0x7fab6c153c50 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36688/0 (socket says 172.21.15.28:36688) 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 -- 172.21.15.28:0/1432714288 learned_addr learned my addr 172.21.15.28:0/1432714288 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab6a59c640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab54004810 0x7fab6c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab6ad9d640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab6c153c50 0x7fab6c15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 -- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab6c153c50 msgr2=0x7fab6c15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab6c153c50 0x7fab6c15fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 -- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab54004810 msgr2=0x7fab6c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab54004810 0x7fab6c14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 -- 172.21.15.28:0/1432714288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0c9960 con 0x7fab6c154890 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab69d9b640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fab6001c8c0 tx=0x7fab60019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600b2040 con 0x7fab6c154890 2024-09-15T22:58:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.812+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6000f000 con 0x7fab6c154890 2024-09-15T22:58:17.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c0c9c40 con 0x7fab6c154890 2024-09-15T22:58:17.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab600096b0 con 0x7fab6c154890 2024-09-15T22:58:17.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c0ca200 con 0x7fab6c154890 2024-09-15T22:58:17.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c0b3a60 con 0x7fab6c154890 2024-09-15T22:58:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab600bf020 con 0x7fab6c154890 2024-09-15T22:58:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab5affd640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fab6011fae0 con 0x7fab6c154890 2024-09-15T22:58:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab6a59c640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.816+0000 7fab6a59c640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 0x7fab4c069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000f90 tx=0x7fab5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:17.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.820+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fab600167a0 con 0x7fab6c154890 2024-09-15T22:58:17.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.984+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fab6c0d38d0 con 0x7fab6c154890 2024-09-15T22:58:17.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab5affd640 1 -- 172.21.15.28:0/1432714288 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fab600f09a0 con 0x7fab6c154890 2024-09-15T22:58:17.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 msgr2=0x7fab4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 0x7fab4c069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000f90 tx=0x7fab5c009040 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 msgr2=0x7fab6c1f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fab6001c8c0 tx=0x7fab60019830 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 shutdown_connections 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab6c153c50 0x7fab6c15fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c154890 0x7fab6c1f4380 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fab4c0678f0 0x7fab4c069db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 --2- 172.21.15.28:0/1432714288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab54004810 0x7fab6c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 >> 172.21.15.28:0/1432714288 conn(0x7fab6c067e00 msgr2=0x7fab6c0d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 shutdown_connections 2024-09-15T22:58:17.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:17.992+0000 7fab70b9a640 1 -- 172.21.15.28:0/1432714288 wait complete. 2024-09-15T22:58:18.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-09-15T22:58:18.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 Processor -- start 2024-09-15T22:58:18.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 -- start start 2024-09-15T22:58:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f999c0b3610 0x7f999c0d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999c06e190 con 0x7f999c15e820 2024-09-15T22:58:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f999c0d2ba0 con 0x7f999c0b3610 2024-09-15T22:58:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a3cd2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f999c0d2e80 con 0x7f999c06d870 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a126d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f999c15e820 0x7f999c0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54398/0 (socket says 172.21.15.28:54398) 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a126d640 1 -- 172.21.15.28:0/342755978 learned_addr learned my addr 172.21.15.28:0/342755978 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a226f640 1 --2- 172.21.15.28:0/342755978 >> v2:172.21.15.28:3300/0 conn(0x7f999c0b3610 0x7f999c0d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a1a6e640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a226f640 1 -- 172.21.15.28:0/342755978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 msgr2=0x7f999c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a226f640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c06dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a226f640 1 -- 172.21.15.28:0/342755978 >> v1:172.21.15.28:6789/0 conn(0x7f999c15e820 legacy=0x7f999c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a0a6c640 1 -- 172.21.15.28:0/342755978 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014306165 0 0) 0x7f999c06e190 con 0x7f999c15e820 2024-09-15T22:58:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.132+0000 7f99a226f640 1 -- 172.21.15.28:0/342755978 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c0d3160 con 0x7f999c0b3610 2024-09-15T22:58:18.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c0b3610 0x7f999c0d3c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9994009d90 tx=0x7f999401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea60a17532e31c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a0a6c640 1 -- 172.21.15.28:0/342755978 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99940b2070 con 0x7f999c0b3610 2024-09-15T22:58:18.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a0a6c640 1 -- 172.21.15.28:0/342755978 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99940a5a00 con 0x7f999c0b3610 2024-09-15T22:58:18.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a0a6c640 1 -- 172.21.15.28:0/342755978 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99940a5dd0 con 0x7f999c0b3610 2024-09-15T22:58:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- 172.21.15.28:0/342755978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c0b3610 msgr2=0x7f999c0d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c0b3610 0x7f999c0d3c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9994009d90 tx=0x7f999401c940 comp rx=0 tx=0).stop 2024-09-15T22:58:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- 172.21.15.28:0/342755978 shutdown_connections 2024-09-15T22:58:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c0b3610 0x7f999c0d3c40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/342755978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c06dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- 172.21.15.28:0/342755978 >> 172.21.15.28:0/342755978 conn(0x7f999c0d4910 msgr2=0x7f999c0d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- 172.21.15.28:0/342755978 shutdown_connections 2024-09-15T22:58:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- 172.21.15.28:0/342755978 wait complete. 2024-09-15T22:58:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 Processor -- start 2024-09-15T22:58:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- start start 2024-09-15T22:58:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999c0b3610 0x7f999c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f999c16b530 con 0x7f999c15e820 2024-09-15T22:58:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f999c16b3b0 con 0x7f999c0b3610 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a3cd2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f999c16b6b0 con 0x7f999c06d870 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36698/0 (socket says 172.21.15.28:36698) 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 -- 172.21.15.28:0/1363459922 learned_addr learned my addr 172.21.15.28:0/1363459922 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a1a6e640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a126d640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999c0b3610 0x7f999c159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 -- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 msgr2=0x7f999c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 -- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999c0b3610 msgr2=0x7f999c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999c0b3610 0x7f999c159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 -- 172.21.15.28:0/1363459922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c157290 con 0x7f999c15e820 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.136+0000 7f99a226f640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f99940b0040 tx=0x7f99940196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99940bd020 con 0x7f999c15e820 2024-09-15T22:58:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99940ad7c0 con 0x7f999c15e820 2024-09-15T22:58:18.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999c159930 con 0x7f999c15e820 2024-09-15T22:58:18.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99940b2040 con 0x7f999c15e820 2024-09-15T22:58:18.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999c159090 con 0x7f999c15e820 2024-09-15T22:58:18.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999c0d3c40 con 0x7f999c15e820 2024-09-15T22:58:18.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99940c0020 con 0x7f999c15e820 2024-09-15T22:58:18.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 0x7f9980069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99a1a6e640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 0x7f9980069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f9994120f20 con 0x7f999c15e820 2024-09-15T22:58:18.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.140+0000 7f99a1a6e640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 0x7f9980069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f999800b9d0 tx=0x7f9998008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.144+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99940c7030 con 0x7f999c15e820 2024-09-15T22:58:18.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.368+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f999c0b9780 con 0x7f999c15e820 2024-09-15T22:58:18.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.664+0000 7f99927fc640 1 -- 172.21.15.28:0/1363459922 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v127) ==== 134+0+0 (secure 0 0 0) 0x7f999c157290 con 0x7f999c15e820 2024-09-15T22:58:18.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 msgr2=0x7f9980069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 0x7f9980069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f999800b9d0 tx=0x7f9998008040 comp rx=0 tx=0).stop 2024-09-15T22:58:18.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 msgr2=0x7f999c0cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f99940b0040 tx=0x7f99940196e0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 shutdown_connections 2024-09-15T22:58:18.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f999c15e820 0x7f999c0cbb80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99800678c0 0x7f9980069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999c0b3610 0x7f999c159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 --2- 172.21.15.28:0/1363459922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999c06d870 0x7f999c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 >> 172.21.15.28:0/1363459922 conn(0x7f999c0d4910 msgr2=0x7f999c15de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 shutdown_connections 2024-09-15T22:58:18.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:18.668+0000 7f99a3cd2640 1 -- 172.21.15.28:0/1363459922 wait complete. 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner: 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner:Ran 2 tests in 89.550s 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner: 2024-09-15T22:58:18.692 INFO:tasks.cephfs_test_runner:OK 2024-09-15T22:58:18.693 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T22:58:18.701 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T22:58:18.770 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T22:58:18.770 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:18.771 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:18.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:58:18.777 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-15T22:58:18.777 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:18.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16629 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:58:18.823 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:58:18.823 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:18.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:58:18.830 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-15T22:58:18.830 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:58:18.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336428k,nr_inodes=4084107,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=21976 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274672k,nr_inodes=818668,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274676k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:58:18.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:18.882 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-15T22:58:18.930 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:58:18.930 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:58:18.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:18.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:58:18.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:18.987 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:58:19.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:19.055 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-15T22:58:19.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:19.227 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-09-15T22:58:19.234 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:58:19.234 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:58:19.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:19.234 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:58:19.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:19.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:58:19.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:58:19.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-09-15T22:58:19.580 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T22:58:19.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:58:19.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:58:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 Processor -- start 2024-09-15T22:58:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 -- start start 2024-09-15T22:58:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 0x7f04180b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f04180b2300 0x7f04180cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180d0960 con 0x7f04180d0190 2024-09-15T22:58:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f04180b2770 con 0x7f04180b2300 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f041d901640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f04180d0f20 con 0x7f0418145970 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f04180b2300 0x7f04180cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f04180b2300 0x7f04180cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36704/0 (socket says 172.21.15.28:36704) 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 -- 172.21.15.28:0/344837751 learned_addr learned my addr 172.21.15.28:0/344837751 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f0416ffd640 1 --2- 172.21.15.28:0/344837751 >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 0x7f04180b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 -- 172.21.15.28:0/344837751 >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 msgr2=0x7f04180b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 --2- 172.21.15.28:0/344837751 >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 0x7f04180b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.715+0000 7f04167fc640 1 -- 172.21.15.28:0/344837751 >> v1:172.21.15.131:6789/0 conn(0x7f04180d0190 legacy=0x7f0418072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f04167fc640 1 -- 172.21.15.28:0/344837751 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180d0c40 con 0x7f04180b2300 2024-09-15T22:58:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f0416ffd640 1 --2- 172.21.15.28:0/344837751 >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 0x7f04180b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:19.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f04167fc640 1 --2- 172.21.15.28:0/344837751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04180b2300 0x7f04180cfc50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f040c009870 tx=0x7f040c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a352ac44840f8e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:19.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f0415ffb640 1 -- 172.21.15.28:0/344837751 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c0b2070 con 0x7f04180b2300 2024-09-15T22:58:19.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f0415ffb640 1 -- 172.21.15.28:0/344837751 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0a9070 con 0x7f04180b2300 2024-09-15T22:58:19.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f0415ffb640 1 -- 172.21.15.28:0/344837751 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c0ad880 con 0x7f04180b2300 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 -- 172.21.15.28:0/344837751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04180b2300 msgr2=0x7f04180cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 --2- 172.21.15.28:0/344837751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04180b2300 0x7f04180cfc50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f040c009870 tx=0x7f040c01c450 comp rx=0 tx=0).stop 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 -- 172.21.15.28:0/344837751 shutdown_connections 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 --2- 172.21.15.28:0/344837751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04180b2300 0x7f04180cfc50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 --2- 172.21.15.28:0/344837751 >> v2:172.21.15.131:3300/0 conn(0x7f0418145970 0x7f04180b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 -- 172.21.15.28:0/344837751 >> 172.21.15.28:0/344837751 conn(0x7f041806bcc0 msgr2=0x7f041806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:19.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 -- 172.21.15.28:0/344837751 shutdown_connections 2024-09-15T22:58:19.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.719+0000 7f041d901640 1 -- 172.21.15.28:0/344837751 wait complete. 2024-09-15T22:58:19.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 Processor -- start 2024-09-15T22:58:19.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- start start 2024-09-15T22:58:19.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04180b2300 0x7f04180b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04180d0190 0x7f0418155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0418168fe0 con 0x7f0418145970 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0418168e60 con 0x7f04180d0190 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f0418169160 con 0x7f04180b2300 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36720/0 (socket says 172.21.15.28:36720) 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 -- 172.21.15.28:0/908231525 learned_addr learned my addr 172.21.15.28:0/908231525 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04167fc640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04180d0190 0x7f0418155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f0416ffd640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04180b2300 0x7f04180b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 -- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04180b2300 msgr2=0x7f04180b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04180b2300 0x7f04180b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 -- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04180d0190 msgr2=0x7f0418155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04180d0190 0x7f0418155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 -- 172.21.15.28:0/908231525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0418141280 con 0x7f0418145970 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f04177fe640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f041000c780 tx=0x7f041000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410004b70 con 0x7f0418145970 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0410004d10 con 0x7f0418145970 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0418141560 con 0x7f0418145970 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041000aa90 con 0x7f0418145970 2024-09-15T22:58:19.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0418141b20 con 0x7f0418145970 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04180cfc50 con 0x7f0418145970 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.723+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f041000ac30 con 0x7f0418145970 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.727+0000 7f03fffff640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 0x7f0404069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.727+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f0410085d00 con 0x7f0418145970 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.727+0000 7f0416ffd640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 0x7f0404069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:19.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.727+0000 7f0416ffd640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 0x7f0404069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f040800a9a0 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:19.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.731+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0410020070 con 0x7f0418145970 2024-09-15T22:58:19.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.891+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0418073c70 con 0x7f04040678f0 2024-09-15T22:58:19.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.891+0000 7f03fffff640 1 -- 172.21.15.28:0/908231525 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13475 (secure 0 0 0) 0x7f0418073c70 con 0x7f04040678f0 2024-09-15T22:58:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:19.897 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:58:19.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 msgr2=0x7f0404069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:19.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 0x7f0404069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f040800a9a0 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 msgr2=0x7f04181409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f041000c780 tx=0x7f041000cc40 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 shutdown_connections 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0418145970 0x7f04181409a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f04040678f0 0x7f0404069db0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04180d0190 0x7f0418155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 --2- 172.21.15.28:0/908231525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04180b2300 0x7f04180b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 >> 172.21.15.28:0/908231525 conn(0x7f041806bcc0 msgr2=0x7f04180cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 shutdown_connections 2024-09-15T22:58:19.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:19.895+0000 7f041d901640 1 -- 172.21.15.28:0/908231525 wait complete. 2024-09-15T22:58:19.916 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-09-15T22:58:17.903405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238564,"kb_used_data":5708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736156,"statfs":{"total":773094113280,"available":772849823744,"internally_reserved":0,"allocated":5844992,"data_stored":3110151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12597,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002245"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T22:58:15.053384+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:58:15.053384+0000","last_peered":"2024-09-15T22:58:15.053384+0000","last_clean":"2024-09-15T22:58:15.053384+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:58:15.053384+0000","last_undegraded":"2024-09-15T22:58:15.053384+0000","last_fullsized":"2024-09-15T22:58:15.053384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1171456,"data_stored":826626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":236786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":569344,"data_stored":236134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":242855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":252460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":577536,"data_stored":236294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":826558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:58:19.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:58:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 Processor -- start 2024-09-15T22:58:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 -- start start 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10bc0b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10bc15d190 con 0x7f10bc0b61a0 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10bc15d470 con 0x7f10bc159e40 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10c0eeb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f10bc15cf50 con 0x7f10bc073080 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10bad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f10bc0b61a0 0x7f10bc0b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54400/0 (socket says 172.21.15.28:54400) 2024-09-15T22:58:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10bad9d640 1 -- 172.21.15.28:0/4015775173 learned_addr learned my addr 172.21.15.28:0/4015775173 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10bc0b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861632285 0 0) 0x7f10bc15d190 con 0x7f10bc0b61a0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.039+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a4003530 con 0x7f10bc0b61a0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3930499019 0 0) 0x7f10a4003530 con 0x7f10bc0b61a0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 msgr2=0x7f10bc0b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10bc0b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 >> v1:172.21.15.131:6789/0 conn(0x7f10bc159e40 legacy=0x7f10bc15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc0b5460 con 0x7f10bc0b61a0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f10b4001a00 con 0x7f10bc0b61a0 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 >> v1:172.21.15.28:6789/0 conn(0x7f10bc0b61a0 legacy=0x7f10bc0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10a40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10a4003f70 0x7f10a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a4004d50 0x7f10a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc15cf50 con 0x7f10a4003f70 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10a400bb60 con 0x7f10a4004d50 2024-09-15T22:58:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f10a400bd60 con 0x7f10bc073080 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10a4003f70 0x7f10a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10ba59c640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10a40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10bad9d640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a4004d50 0x7f10a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 -- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 msgr2=0x7f10a40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc073080 0x7f10a40039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 -- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a4004d50 msgr2=0x7f10a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a4004d50 0x7f10a40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 -- 172.21.15.28:0/4015775173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a4003530 con 0x7f10a4003f70 2024-09-15T22:58:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10bad9d640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10a4004d50 0x7f10a40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10a4003f70 0x7f10a4004810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ab0 tx=0x7f10ac01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13ee9586d9a8015 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0096b0 con 0x7f10a4003f70 2024-09-15T22:58:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ac0a6430 con 0x7f10a4003f70 2024-09-15T22:58:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10b959a640 1 -- 172.21.15.28:0/4015775173 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0a67e0 con 0x7f10a4003f70 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 -- 172.21.15.28:0/4015775173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10a4003f70 msgr2=0x7f10a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/4015775173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10a4003f70 0x7f10a4004810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ab0 tx=0x7f10ac01ca50 comp rx=0 tx=0).stop 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10bad9d640 1 -- 172.21.15.28:0/4015775173 reap_dead start 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 -- 172.21.15.28:0/4015775173 shutdown_connections 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 -- 172.21.15.28:0/4015775173 >> 172.21.15.28:0/4015775173 conn(0x7f10bc06bec0 msgr2=0x7f10bc06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 -- 172.21.15.28:0/4015775173 shutdown_connections 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.043+0000 7f10c0eeb640 1 -- 172.21.15.28:0/4015775173 wait complete. 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 Processor -- start 2024-09-15T22:58:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- start start 2024-09-15T22:58:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10a4003f70 0x7f10bc1f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc15c050 0x7f10bc0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc0b5c40 con 0x7f10bc153e50 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc0b5dc0 con 0x7f10bc15c050 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f10bc0b5f40 con 0x7f10a4003f70 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36724/0 (socket says 172.21.15.28:36724) 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 -- 172.21.15.28:0/837983412 learned_addr learned my addr 172.21.15.28:0/837983412 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10b9d9b640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc15c050 0x7f10bc0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10ba59c640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10a4003f70 0x7f10bc1f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 -- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10a4003f70 msgr2=0x7f10bc1f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10a4003f70 0x7f10bc1f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 -- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc15c050 msgr2=0x7f10bc0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc15c050 0x7f10bc0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 -- 172.21.15.28:0/837983412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc15c4d0 con 0x7f10bc153e50 2024-09-15T22:58:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10bad9d640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000f90 tx=0x7f10b400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b400de90 con 0x7f10bc153e50 2024-09-15T22:58:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b400bb80 con 0x7f10bc153e50 2024-09-15T22:58:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc0afdf0 con 0x7f10bc153e50 2024-09-15T22:58:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4007110 con 0x7f10bc153e50 2024-09-15T22:58:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc0b03b0 con 0x7f10bc153e50 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.047+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10bc15df60 con 0x7f10bc153e50 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.051+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10b401b060 con 0x7f10bc153e50 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.051+0000 7f10aaffd640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 0x7f109c069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.051+0000 7f10ba59c640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 0x7f109c069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.051+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f10b40859a0 con 0x7f10bc153e50 2024-09-15T22:58:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.051+0000 7f10ba59c640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 0x7f109c069f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10b00016e0 tx=0x7f10b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.055+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10b4056870 con 0x7f10bc153e50 2024-09-15T22:58:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.215+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10bc0ce770 con 0x7f109c067a60 2024-09-15T22:58:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10aaffd640 1 -- 172.21.15.28:0/837983412 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13475 (secure 0 0 0) 0x7f10bc0ce770 con 0x7f109c067a60 2024-09-15T22:58:20.223 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:58:20.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 msgr2=0x7f109c069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 0x7f109c069f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f10b00016e0 tx=0x7f10b0009040 comp rx=0 tx=0).stop 2024-09-15T22:58:20.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 msgr2=0x7f10bc0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000f90 tx=0x7f10b400b4a0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 shutdown_connections 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc153e50 0x7f10bc0b1fa0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f109c067a60 0x7f109c069f20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc15c050 0x7f10bc0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 --2- 172.21.15.28:0/837983412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10a4003f70 0x7f10bc1f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 >> 172.21.15.28:0/837983412 conn(0x7f10bc06bec0 msgr2=0x7f10bc1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 shutdown_connections 2024-09-15T22:58:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.219+0000 7f10c0eeb640 1 -- 172.21.15.28:0/837983412 wait complete. 2024-09-15T22:58:20.242 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-15T22:58:19.903852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238564,"kb_used_data":5708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736156,"statfs":{"total":773094113280,"available":772849823744,"internally_reserved":0,"allocated":5844992,"data_stored":3110151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12597,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T22:58:15.053384+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:58:15.053384+0000","last_peered":"2024-09-15T22:58:15.053384+0000","last_clean":"2024-09-15T22:58:15.053384+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:58:15.053384+0000","last_undegraded":"2024-09-15T22:58:15.053384+0000","last_fullsized":"2024-09-15T22:58:15.053384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1171456,"data_stored":826626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":236786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":569344,"data_stored":236134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":242855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":252460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":577536,"data_stored":236294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":826558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:58:20.242 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:58:20.242 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:58:20.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.355+0000 7faa1409d640 1 Processor -- start 2024-09-15T22:58:20.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 -- start start 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa0c145970 0x7faa0c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa0c0d0360 0x7faa0c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c0d0960 con 0x7faa0c0b2300 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7faa0c0b2770 con 0x7faa0c145970 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1409d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa0c0d0f20 con 0x7faa0c0d0360 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa0c145970 0x7faa0c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa0c145970 0x7faa0c0b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36738/0 (socket says 172.21.15.28:36738) 2024-09-15T22:58:20.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 -- 172.21.15.28:0/2155145899 learned_addr learned my addr 172.21.15.28:0/2155145899 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa1263a640 1 --2- 172.21.15.28:0/2155145899 >> v2:172.21.15.131:3300/0 conn(0x7faa0c0d0360 0x7faa0c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 -- 172.21.15.28:0/2155145899 >> v2:172.21.15.131:3300/0 conn(0x7faa0c0d0360 msgr2=0x7faa0c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 --2- 172.21.15.28:0/2155145899 >> v2:172.21.15.131:3300/0 conn(0x7faa0c0d0360 0x7faa0c0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 -- 172.21.15.28:0/2155145899 >> v1:172.21.15.131:6789/0 conn(0x7faa0c0b2300 legacy=0x7faa0c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.359+0000 7faa11e39640 1 -- 172.21.15.28:0/2155145899 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c0d0c40 con 0x7faa0c145970 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11e39640 1 --2- 172.21.15.28:0/2155145899 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c145970 0x7faa0c0b1dc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a580e95ed22995 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa10e37640 1 -- 172.21.15.28:0/2155145899 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b1070 con 0x7faa0c145970 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa10e37640 1 -- 172.21.15.28:0/2155145899 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080ac600 con 0x7faa0c145970 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa10e37640 1 -- 172.21.15.28:0/2155145899 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ac9d0 con 0x7faa0c145970 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- 172.21.15.28:0/2155145899 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c145970 msgr2=0x7faa0c0b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- 172.21.15.28:0/2155145899 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c145970 0x7faa0c0b1dc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0801c490 comp rx=0 tx=0).stop 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- 172.21.15.28:0/2155145899 shutdown_connections 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- 172.21.15.28:0/2155145899 >> v2:172.21.15.131:3300/0 conn(0x7faa0c0d0360 0x7faa0c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- 172.21.15.28:0/2155145899 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c145970 0x7faa0c0b1dc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- 172.21.15.28:0/2155145899 >> 172.21.15.28:0/2155145899 conn(0x7faa0c06bcc0 msgr2=0x7faa0c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- 172.21.15.28:0/2155145899 shutdown_connections 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- 172.21.15.28:0/2155145899 wait complete. 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 Processor -- start 2024-09-15T22:58:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- start start 2024-09-15T22:58:20.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa0c0b2300 0x7faa0c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 0x7faa0c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0cebd0 con 0x7faa0c0d0360 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0cea50 con 0x7faa0c145970 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1409d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c0ced50 con 0x7faa0c0b2300 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36742/0 (socket says 172.21.15.28:36742) 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 -- 172.21.15.28:0/218962340 learned_addr learned my addr 172.21.15.28:0/218962340 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11e39640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa0c0b2300 0x7faa0c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1263a640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 0x7faa0c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 -- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa0c0b2300 msgr2=0x7faa0c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa0c0b2300 0x7faa0c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 -- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 msgr2=0x7faa0c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 0x7faa0c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa11638640 1 -- 172.21.15.28:0/218962340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c15e410 con 0x7faa0c0d0360 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.363+0000 7faa1263a640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 0x7faa0c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa11638640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c3a0 tx=0x7fa9fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0052d0 con 0x7faa0c0d0360 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc005470 con 0x7faa0c0d0360 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007260 con 0x7faa0c0d0360 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c15e6f0 con 0x7faa0c0d0360 2024-09-15T22:58:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c15ef90 con 0x7faa0c0d0360 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c15f190 con 0x7faa0c0d0360 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9fc007400 con 0x7faa0c0d0360 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 0x7fa9f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fa9fc084e00 con 0x7faa0c0d0360 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa11e39640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 0x7fa9f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.367+0000 7faa11e39640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 0x7fa9f0069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa080ae000 tx=0x7faa080a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.371+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa0c15f190 con 0x7faa0c0d0360 2024-09-15T22:58:20.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.531+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa0c0cda90 con 0x7fa9f00678c0 2024-09-15T22:58:20.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.531+0000 7faa027fc640 1 -- 172.21.15.28:0/218962340 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13475 (secure 0 0 0) 0x7faa0c0cda90 con 0x7fa9f00678c0 2024-09-15T22:58:20.537 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:20.537 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 msgr2=0x7fa9f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 0x7fa9f0069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa080ae000 tx=0x7faa080a7000 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 msgr2=0x7faa0c15d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c3a0 tx=0x7fa9fc00c860 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 shutdown_connections 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fa9f00678c0 0x7fa9f0069d80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa0c145970 0x7faa0c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa0c0d0360 0x7faa0c15d410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 --2- 172.21.15.28:0/218962340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa0c0b2300 0x7faa0c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 >> 172.21.15.28:0/218962340 conn(0x7faa0c06bcc0 msgr2=0x7faa0c0ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 shutdown_connections 2024-09-15T22:58:20.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.535+0000 7faa1409d640 1 -- 172.21.15.28:0/218962340 wait complete. 2024-09-15T22:58:20.557 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-15T22:58:19.903852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238564,"kb_used_data":5708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736156,"statfs":{"total":773094113280,"available":772849823744,"internally_reserved":0,"allocated":5844992,"data_stored":3110151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12597,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T22:58:15.053384+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:58:15.053384+0000","last_peered":"2024-09-15T22:58:15.053384+0000","last_clean":"2024-09-15T22:58:15.053384+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:58:15.053384+0000","last_undegraded":"2024-09-15T22:58:15.053384+0000","last_fullsized":"2024-09-15T22:58:15.053384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28168,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343672,"statfs":{"total":96636764160,"available":96607920128,"internally_reserved":0,"allocated":1171456,"data_stored":826626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":577536,"data_stored":236786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":569344,"data_stored":236134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":242855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":252460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":593920,"data_stored":252438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":577536,"data_stored":236294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":826558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:58:20.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:58:20.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 Processor -- start 2024-09-15T22:58:20.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 -- start start 2024-09-15T22:58:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff36806bcc0 0x7ff3680ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36806c2a0 con 0x7ff36815e220 2024-09-15T22:58:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36806c580 con 0x7ff3680ca9d0 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36cc1e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff3680cae00 con 0x7ff36806bcc0 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff36806bcc0 0x7ff3680ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff36806bcc0 0x7ff3680ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36752/0 (socket says 172.21.15.28:36752) 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 -- 172.21.15.28:0/3787722602 learned_addr learned my addr 172.21.15.28:0/3787722602 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff36659c640 1 --1- 172.21.15.28:0/3787722602 >> v1:172.21.15.28:6789/0 conn(0x7ff36815e220 0x7ff368162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54404/0 (socket says 172.21.15.28:54404) 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 -- 172.21.15.28:0/3787722602 >> v1:172.21.15.131:6789/0 conn(0x7ff3680ca9d0 legacy=0x7ff3680cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 -- 172.21.15.28:0/3787722602 >> v1:172.21.15.28:6789/0 conn(0x7ff36815e220 legacy=0x7ff368162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.679+0000 7ff365d9b640 1 -- 172.21.15.28:0/3787722602 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36806c860 con 0x7ff36806bcc0 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff365d9b640 1 --2- 172.21.15.28:0/3787722602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff3680ca490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009870 tx=0x7ff35c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e2183bcdc42f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36559a640 1 -- 172.21.15.28:0/3787722602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0b0070 con 0x7ff36806bcc0 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36559a640 1 -- 172.21.15.28:0/3787722602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c0ab600 con 0x7ff36806bcc0 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36559a640 1 -- 172.21.15.28:0/3787722602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0ab9d0 con 0x7ff36806bcc0 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- 172.21.15.28:0/3787722602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 msgr2=0x7ff3680ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/3787722602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff3680ca490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009870 tx=0x7ff35c01c380 comp rx=0 tx=0).stop 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- 172.21.15.28:0/3787722602 shutdown_connections 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/3787722602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff3680ca490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- 172.21.15.28:0/3787722602 >> 172.21.15.28:0/3787722602 conn(0x7ff3680cdbe0 msgr2=0x7ff3680cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- 172.21.15.28:0/3787722602 shutdown_connections 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- 172.21.15.28:0/3787722602 wait complete. 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 Processor -- start 2024-09-15T22:58:20.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- start start 2024-09-15T22:58:20.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3680ca9d0 0x7ff3681529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 0x7ff368156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff36815e780 con 0x7ff36806bcc0 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff36815e600 con 0x7ff3680ca9d0 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36cc1e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff36816c2f0 con 0x7ff36815e220 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36754/0 (socket says 172.21.15.28:36754) 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 -- 172.21.15.28:0/1472398267 learned_addr learned my addr 172.21.15.28:0/1472398267 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff366d9d640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 0x7ff368156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff365d9b640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3680ca9d0 0x7ff3681529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 -- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 msgr2=0x7ff368156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 0x7ff368156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.683+0000 7ff36659c640 1 -- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3680ca9d0 msgr2=0x7ff3681529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36659c640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3680ca9d0 0x7ff3681529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36659c640 1 -- 172.21.15.28:0/1472398267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368155110 con 0x7ff36806bcc0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff366d9d640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 0x7ff368156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36659c640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c780 tx=0x7ff35800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358018070 con 0x7ff36806bcc0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580072d0 con 0x7ff36806bcc0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580047f0 con 0x7ff36806bcc0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff368155380 con 0x7ff36806bcc0 2024-09-15T22:58:20.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff368155c20 con 0x7ff36806bcc0 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff368155770 con 0x7ff36806bcc0 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff358004990 con 0x7ff36806bcc0 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 0x7ff348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff365d9b640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 0x7ff348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7ff358085650 con 0x7ff36806bcc0 2024-09-15T22:58:20.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.687+0000 7ff365d9b640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 0x7ff348069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cafc0 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.691+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff358021070 con 0x7ff36806bcc0 2024-09-15T22:58:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3680ca490 con 0x7ff36806bcc0 2024-09-15T22:58:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff356ffd640 1 -- 172.21.15.28:0/1472398267 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13044 (secure 0 0 0) 0x7ff358056500 con 0x7ff36806bcc0 2024-09-15T22:58:20.856 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:20.856 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"fsid":"f44574f1-d935-4d4e-b79e-1e1910665f93","created":"2024-09-15T22:55:57.071258+0000","modified":"2024-09-15T22:58:17.645217+0000","last_up_change":"2024-09-15T22:56:09.631052+0000","last_in_change":"2024-09-15T22:55:59.442387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:56:09.941276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f9b9c5b9-4f0d-4cef-b59e-b815584470b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6801","nonce":426082887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6803","nonce":426082887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6807","nonce":426082887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":426082887},{"type":"v1","addr":"172.21.15.28:6805","nonce":426082887}]},"public_addr":"172.21.15.28:6801/426082887","cluster_addr":"172.21.15.28:6803/426082887","heartbeat_back_addr":"172.21.15.28:6807/426082887","heartbeat_front_addr":"172.21.15.28:6805/426082887","state":["exists","up"]},{"osd":1,"uuid":"717b2c63-937b-410d-b5be-0f7b5cd31216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6809","nonce":3529915784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6811","nonce":3529915784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6815","nonce":3529915784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3529915784},{"type":"v1","addr":"172.21.15.28:6813","nonce":3529915784}]},"public_addr":"172.21.15.28:6809/3529915784","cluster_addr":"172.21.15.28:6811/3529915784","heartbeat_back_addr":"172.21.15.28:6815/3529915784","heartbeat_front_addr":"172.21.15.28:6813/3529915784","state":["exists","up"]},{"osd":2,"uuid":"2da47dbb-c7d9-4b9f-8c8e-65defcdb9341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6817","nonce":1391193477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6819","nonce":1391193477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6823","nonce":1391193477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1391193477},{"type":"v1","addr":"172.21.15.28:6821","nonce":1391193477}]},"public_addr":"172.21.15.28:6817/1391193477","cluster_addr":"172.21.15.28:6819/1391193477","heartbeat_back_addr":"172.21.15.28:6823/1391193477","heartbeat_front_addr":"172.21.15.28:6821/1391193477","state":["exists","up"]},{"osd":3,"uuid":"71babbc1-5d3d-49a7-996c-f8700485f1e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6825","nonce":1666455377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6827","nonce":1666455377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6831","nonce":1666455377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1666455377},{"type":"v1","addr":"172.21.15.28:6829","nonce":1666455377}]},"public_addr":"172.21.15.28:6825/1666455377","cluster_addr":"172.21.15.28:6827/1666455377","heartbeat_back_addr":"172.21.15.28:6831/1666455377","heartbeat_front_addr":"172.21.15.28:6829/1666455377","state":["exists","up"]},{"osd":4,"uuid":"7710215d-614e-4055-9384-ea354564e681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6801","nonce":3878671609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6803","nonce":3878671609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6807","nonce":3878671609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3878671609},{"type":"v1","addr":"172.21.15.131:6805","nonce":3878671609}]},"public_addr":"172.21.15.131:6801/3878671609","cluster_addr":"172.21.15.131:6803/3878671609","heartbeat_back_addr":"172.21.15.131:6807/3878671609","heartbeat_front_addr":"172.21.15.131:6805/3878671609","state":["exists","up"]},{"osd":5,"uuid":"de18fdfa-3ae6-4b53-beb7-fe3927145a4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6809","nonce":1626453744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6811","nonce":1626453744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6815","nonce":1626453744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1626453744},{"type":"v1","addr":"172.21.15.131:6813","nonce":1626453744}]},"public_addr":"172.21.15.131:6809/1626453744","cluster_addr":"172.21.15.131:6811/1626453744","heartbeat_back_addr":"172.21.15.131:6815/1626453744","heartbeat_front_addr":"172.21.15.131:6813/1626453744","state":["exists","up"]},{"osd":6,"uuid":"aae72c2c-a564-4160-a5c8-139a3d3256e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6817","nonce":1452359043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6819","nonce":1452359043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6823","nonce":1452359043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1452359043},{"type":"v1","addr":"172.21.15.131:6821","nonce":1452359043}]},"public_addr":"172.21.15.131:6817/1452359043","cluster_addr":"172.21.15.131:6819/1452359043","heartbeat_back_addr":"172.21.15.131:6823/1452359043","heartbeat_front_addr":"172.21.15.131:6821/1452359043","state":["exists","up"]},{"osd":7,"uuid":"74ba03b6-cf6a-4f5d-8a89-acf25c2edd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6825","nonce":1980628062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6827","nonce":1980628062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6831","nonce":1980628062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":1980628062},{"type":"v1","addr":"172.21.15.131:6829","nonce":1980628062}]},"public_addr":"172.21.15.131:6825/1980628062","cluster_addr":"172.21.15.131:6827/1980628062","heartbeat_back_addr":"172.21.15.131:6831/1980628062","heartbeat_front_addr":"172.21.15.131:6829/1980628062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.336201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.727505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.795005+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.939083+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.235526+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.760630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.699692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:56:06.943448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6837/4207620885":"2024-09-16T22:58:14.630263+0000","172.21.15.28:6836/4207620885":"2024-09-16T22:58:14.630263+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:58:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 msgr2=0x7ff348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 0x7ff348069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cafc0 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 msgr2=0x7ff368156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c780 tx=0x7ff35800cc40 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 shutdown_connections 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff36815e220 0x7ff368156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7ff3480678c0 0x7ff348069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3680ca9d0 0x7ff3681529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 --2- 172.21.15.28:0/1472398267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff36806bcc0 0x7ff368156140 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.851+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 >> 172.21.15.28:0/1472398267 conn(0x7ff3680cdbe0 msgr2=0x7ff3680cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.855+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 shutdown_connections 2024-09-15T22:58:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:20.855+0000 7ff36cc1e640 1 -- 172.21.15.28:0/1472398267 wait complete. 2024-09-15T22:58:21.874 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T22:58:21.874 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:22.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.011+0000 7f9ce6d3c640 1 Processor -- start 2024-09-15T22:58:22.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 -- start start 2024-09-15T22:58:22.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 0x7f9ce00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9ce00d0730 0x7f9ce00ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce015c0c0 con 0x7f9ce015b8d0 2024-09-15T22:58:22.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00ce1a0 con 0x7f9ce00d0730 2024-09-15T22:58:22.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce6d3c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce015c3a0 con 0x7f9ce0155a40 2024-09-15T22:58:22.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9ce00d0730 0x7f9ce00ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9ce00d0730 0x7f9ce00ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36758/0 (socket says 172.21.15.28:36758) 2024-09-15T22:58:22.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 -- 172.21.15.28:0/3005325824 learned_addr learned my addr 172.21.15.28:0/3005325824 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce4ad8640 1 --2- 172.21.15.28:0/3005325824 >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 0x7f9ce00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 -- 172.21.15.28:0/3005325824 >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 msgr2=0x7f9ce00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 --2- 172.21.15.28:0/3005325824 >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 0x7f9ce00b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 -- 172.21.15.28:0/3005325824 >> v1:172.21.15.131:6789/0 conn(0x7f9ce015b8d0 legacy=0x7f9ce00d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce52d9640 1 -- 172.21.15.28:0/3005325824 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce015c680 con 0x7f9ce00d0730 2024-09-15T22:58:22.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.015+0000 7f9ce4ad8640 1 --2- 172.21.15.28:0/3005325824 >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 0x7f9ce00b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:22.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce52d9640 1 --2- 172.21.15.28:0/3005325824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce00ce630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00cdc50 tx=0x7f9cd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea3b0095e678964 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3005325824 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80b0070 con 0x7f9ce00d0730 2024-09-15T22:58:22.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3005325824 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80ab600 con 0x7f9ce00d0730 2024-09-15T22:58:22.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9cdf7fe640 1 -- 172.21.15.28:0/3005325824 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80ab9d0 con 0x7f9ce00d0730 2024-09-15T22:58:22.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/3005325824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 msgr2=0x7f9ce00ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/3005325824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce00ce630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00cdc50 tx=0x7f9cd801c520 comp rx=0 tx=0).stop 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/3005325824 shutdown_connections 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/3005325824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce00ce630 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/3005325824 >> v2:172.21.15.131:3300/0 conn(0x7f9ce0155a40 0x7f9ce00b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/3005325824 >> 172.21.15.28:0/3005325824 conn(0x7f9ce006bcc0 msgr2=0x7f9ce006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/3005325824 shutdown_connections 2024-09-15T22:58:22.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/3005325824 wait complete. 2024-09-15T22:58:22.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 Processor -- start 2024-09-15T22:58:22.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- start start 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce0073c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce0155a40 0x7f9ce01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce015b8d0 0x7f9ce014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00cf750 con 0x7f9ce00d0730 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00cf5d0 con 0x7f9ce015b8d0 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce6d3c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00cf8d0 con 0x7f9ce0155a40 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce4ad8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce0073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce4ad8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce0073c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36768/0 (socket says 172.21.15.28:36768) 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce4ad8640 1 -- 172.21.15.28:0/2599515846 learned_addr learned my addr 172.21.15.28:0/2599515846 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9ce52d9640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce015b8d0 0x7f9ce014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.019+0000 7f9cdffff640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce0155a40 0x7f9ce01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 -- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce0155a40 msgr2=0x7f9ce01529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ce0155a40 0x7f9ce01529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 -- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce015b8d0 msgr2=0x7f9ce014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ce015b8d0 0x7f9ce014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce0071d60 con 0x7f9ce00d0730 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce4ad8640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce0073c60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000e840 tx=0x7f9cd000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0017070 con 0x7f9ce00d0730 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd000c8d0 con 0x7f9ce00d0730 2024-09-15T22:58:22.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce00717a0 con 0x7f9ce00d0730 2024-09-15T22:58:22.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000f040 con 0x7f9ce00d0730 2024-09-15T22:58:22.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce0073460 con 0x7f9ce00d0730 2024-09-15T22:58:22.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ce0069220 con 0x7f9ce00d0730 2024-09-15T22:58:22.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cd001a070 con 0x7f9ce00d0730 2024-09-15T22:58:22.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9cc00678c0 0x7f9cc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f9cd0085a70 con 0x7f9ce00d0730 2024-09-15T22:58:22.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdffff640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9cc00678c0 0x7f9cc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f9cc006d780 0x7f9cc006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cc0070250 con 0x7f9cc006d780 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f9cd0085f00 con 0x7f9ce00d0730 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce52d9640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f9cc006d780 0x7f9cc006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdffff640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9cc00678c0 0x7f9cc0069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0152550 tx=0x7f9cc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9ce52d9640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f9cc006d780 0x7f9cc006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.023+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== osd.0 v2:172.21.15.28:6800/426082887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cc0070250 con 0x7f9cc006d780 2024-09-15T22:58:22.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 --> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ce00ce630 con 0x7f9cc006d780 2024-09-15T22:58:22.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9cdd7fa640 1 -- 172.21.15.28:0/2599515846 <== osd.0 v2:172.21.15.28:6800/426082887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9ce00ce630 con 0x7f9cc006d780 2024-09-15T22:58:22.044 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:22.044 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:22.044 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f9cc006d780 msgr2=0x7f9cc006fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6800/426082887,v1:172.21.15.28:6801/426082887] conn(0x7f9cc006d780 0x7f9cc006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9cc00678c0 msgr2=0x7f9cc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f9cc00678c0 0x7f9cc0069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0152550 tx=0x7f9cc8009040 comp rx=0 tx=0).stop 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 msgr2=0x7f9ce0073c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 --2- 172.21.15.28:0/2599515846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ce00d0730 0x7f9ce0073c60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000e840 tx=0x7f9cd000ed00 comp rx=0 tx=0).stop 2024-09-15T22:58:22.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce52d9640 1 -- 172.21.15.28:0/2599515846 reap_dead start 2024-09-15T22:58:22.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 shutdown_connections 2024-09-15T22:58:22.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 >> 172.21.15.28:0/2599515846 conn(0x7f9ce006bcc0 msgr2=0x7f9ce00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 shutdown_connections 2024-09-15T22:58:22.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.039+0000 7f9ce6d3c640 1 -- 172.21.15.28:0/2599515846 wait complete. 2024-09-15T22:58:22.061 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T22:58:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 Processor -- start 2024-09-15T22:58:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 -- start start 2024-09-15T22:58:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2e40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2e40aef20 0x7fd2e40af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e40b4450 con 0x7fd2e40cfa80 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e40b4780 con 0x7fd2e40aef20 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ebe88640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40b3960 con 0x7fd2e415e370 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e9423640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd2e40cfa80 0x7fd2e40b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54418/0 (socket says 172.21.15.28:54418) 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e9423640 1 -- 172.21.15.28:0/3987720411 learned_addr learned my addr 172.21.15.28:0/3987720411 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e9c24640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2e40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2ea425640 1 --2- 172.21.15.28:0/3987720411 >> v2:172.21.15.131:3300/0 conn(0x7fd2e40aef20 0x7fd2e40af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617901224 0 0) 0x7fd2e40b4450 con 0x7fd2e40cfa80 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2cc003530 con 0x7fd2e40cfa80 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411016678 0 0) 0x7fd2cc003530 con 0x7fd2e40cfa80 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 msgr2=0x7fd2e40b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2e40b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 >> v2:172.21.15.131:3300/0 conn(0x7fd2e40aef20 msgr2=0x7fd2e40af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 --2- 172.21.15.28:0/3987720411 >> v2:172.21.15.131:3300/0 conn(0x7fd2e40aef20 0x7fd2e40af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e40b3c40 con 0x7fd2e40cfa80 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd2d8001680 con 0x7fd2e40cfa80 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 >> v1:172.21.15.28:6789/0 conn(0x7fd2e40cfa80 legacy=0x7fd2e40b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0039c0 0x7fd2cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.175+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40b4780 con 0x7fd2cc004810 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e40b3960 con 0x7fd2cc0039c0 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc00b9d0 con 0x7fd2e415e370 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ea425640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9c24640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0039c0 0x7fd2cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 -- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 msgr2=0x7fd2cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e415e370 0x7fd2cc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 -- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0039c0 msgr2=0x7fd2cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc0039c0 0x7fd2cc003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 -- 172.21.15.28:0/3987720411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc003530 con 0x7fd2cc004810 2024-09-15T22:58:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e9423640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c240 tx=0x7fd2d801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf781e61d069999 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8007d40 con 0x7fd2cc004810 2024-09-15T22:58:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80ac020 con 0x7fd2cc004810 2024-09-15T22:58:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2e8c22640 1 -- 172.21.15.28:0/3987720411 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80058e0 con 0x7fd2cc004810 2024-09-15T22:58:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3987720411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2cc004810 msgr2=0x7fd2cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3987720411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c240 tx=0x7fd2d801f3d0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ea425640 1 -- 172.21.15.28:0/3987720411 reap_dead start 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3987720411 shutdown_connections 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3987720411 >> 172.21.15.28:0/3987720411 conn(0x7fd2e406bcc0 msgr2=0x7fd2e406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3987720411 shutdown_connections 2024-09-15T22:58:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.179+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3987720411 wait complete. 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 Processor -- start 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- start start 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc004810 0x7fd2e4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4148620 0x7fd2e4148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e415e8d0 con 0x7fd2e4072d50 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e415e750 con 0x7fd2cc004810 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e40b5320 con 0x7fd2e4148620 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36774/0 (socket says 172.21.15.28:36774) 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 -- 172.21.15.28:0/3004095149 learned_addr learned my addr 172.21.15.28:0/3004095149 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2e9c24640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc004810 0x7fd2e4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2e9423640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4148620 0x7fd2e4148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 -- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4148620 msgr2=0x7fd2e4148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4148620 0x7fd2e4148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 -- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc004810 msgr2=0x7fd2e4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc004810 0x7fd2e4070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 -- 172.21.15.28:0/3004095149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e4148fc0 con 0x7fd2e4072d50 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ea425640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd2e406f080 tx=0x7fd2d4010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400f040 con 0x7fd2e4072d50 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d401c070 con 0x7fd2e4072d50 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e4158e00 con 0x7fd2e4072d50 2024-09-15T22:58:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400eb10 con 0x7fd2e4072d50 2024-09-15T22:58:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e40739e0 con 0x7fd2e4072d50 2024-09-15T22:58:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.183+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e40af3b0 con 0x7fd2e4072d50 2024-09-15T22:58:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.187+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2d400ecb0 con 0x7fd2e4072d50 2024-09-15T22:58:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.187+0000 7fd2e27fc640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 0x7fd2d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.187+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fd2d40856b0 con 0x7fd2e4072d50 2024-09-15T22:58:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.187+0000 7fd2e9c24640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 0x7fd2d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.187+0000 7fd2e9c24640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 0x7fd2d0069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009fd0 tx=0x7fd2dc00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.191+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2d4026020 con 0x7fd2e4072d50 2024-09-15T22:58:22.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd2e41596b0 con 0x7fd2d00678f0 2024-09-15T22:58:22.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2e27fc640 1 -- 172.21.15.28:0/3004095149 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd2e41596b0 con 0x7fd2d00678f0 2024-09-15T22:58:22.355 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T22:58:22.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 msgr2=0x7fd2d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 0x7fd2d0069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009fd0 tx=0x7fd2dc00d040 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 msgr2=0x7fd2e40731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd2e406f080 tx=0x7fd2d4010b70 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 shutdown_connections 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2e4072d50 0x7fd2e40731d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4148620 0x7fd2e4148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd2d00678f0 0x7fd2d0069db0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 --2- 172.21.15.28:0/3004095149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2cc004810 0x7fd2e4070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 >> 172.21.15.28:0/3004095149 conn(0x7fd2e406bcc0 msgr2=0x7fd2e40b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 shutdown_connections 2024-09-15T22:58:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.351+0000 7fd2ebe88640 1 -- 172.21.15.28:0/3004095149 wait complete. 2024-09-15T22:58:22.374 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T22:58:22.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 Processor -- start 2024-09-15T22:58:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 -- start start 2024-09-15T22:58:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 0x7f435c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f435c0ccc50 0x7f435c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435c0ce0c0 con 0x7f435c158ca0 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0af740 con 0x7f435c0ccc50 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4362daf640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0cecd0 con 0x7f435c0cff80 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f436134c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f435c0ccc50 0x7f435c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4360b4b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f435c158ca0 0x7f435c0af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54434/0 (socket says 172.21.15.28:54434) 2024-09-15T22:58:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.491+0000 7f4360b4b640 1 -- 172.21.15.28:0/3037663813 learned_addr learned my addr 172.21.15.28:0/3037663813 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435bfff640 1 --2- 172.21.15.28:0/3037663813 >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 0x7f435c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f436134c640 1 -- 172.21.15.28:0/3037663813 >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 msgr2=0x7f435c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f436134c640 1 --2- 172.21.15.28:0/3037663813 >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 0x7f435c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f436134c640 1 -- 172.21.15.28:0/3037663813 >> v1:172.21.15.28:6789/0 conn(0x7f435c158ca0 legacy=0x7f435c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f436134c640 1 -- 172.21.15.28:0/3037663813 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0ce3a0 con 0x7f435c0ccc50 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435b7fe640 1 -- 172.21.15.28:0/3037663813 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718900737 0 0) 0x7f435c0ce0c0 con 0x7f435c158ca0 2024-09-15T22:58:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435bfff640 1 --2- 172.21.15.28:0/3037663813 >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 0x7f435c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f436134c640 1 --2- 172.21.15.28:0/3037663813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c0ccc50 0x7f435c0cd060 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f435c0cc220 tx=0x7f435401c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218019edbc4cacd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435b7fe640 1 -- 172.21.15.28:0/3037663813 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540b2070 con 0x7f435c0ccc50 2024-09-15T22:58:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435b7fe640 1 -- 172.21.15.28:0/3037663813 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43540a5780 con 0x7f435c0ccc50 2024-09-15T22:58:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f435b7fe640 1 -- 172.21.15.28:0/3037663813 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540a5b50 con 0x7f435c0ccc50 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 -- 172.21.15.28:0/3037663813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c0ccc50 msgr2=0x7f435c0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 --2- 172.21.15.28:0/3037663813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c0ccc50 0x7f435c0cd060 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f435c0cc220 tx=0x7f435401c7d0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 -- 172.21.15.28:0/3037663813 shutdown_connections 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 --2- 172.21.15.28:0/3037663813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c0ccc50 0x7f435c0cd060 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 --2- 172.21.15.28:0/3037663813 >> v2:172.21.15.131:3300/0 conn(0x7f435c0cff80 0x7f435c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 -- 172.21.15.28:0/3037663813 >> 172.21.15.28:0/3037663813 conn(0x7f435c06bcc0 msgr2=0x7f435c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 -- 172.21.15.28:0/3037663813 shutdown_connections 2024-09-15T22:58:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.495+0000 7f4362daf640 1 -- 172.21.15.28:0/3037663813 wait complete. 2024-09-15T22:58:22.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 Processor -- start 2024-09-15T22:58:22.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- start start 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f435c0ccc50 0x7f435c145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f435c0cff80 0x7f435c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 0x7f435c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0aeb80 con 0x7f435c158ca0 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f435c0aea00 con 0x7f435c0ccc50 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0b3540 con 0x7f435c0cff80 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 0x7f435c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 0x7f435c151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36796/0 (socket says 172.21.15.28:36796) 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 -- 172.21.15.28:0/160619530 learned_addr learned my addr 172.21.15.28:0/160619530 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f435bfff640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f435c0cff80 0x7f435c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4360b4b640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f435c0ccc50 0x7f435c145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 -- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f435c0cff80 msgr2=0x7f435c1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f435c0cff80 0x7f435c1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 -- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f435c0ccc50 msgr2=0x7f435c145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f435c0ccc50 0x7f435c145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c144e00 con 0x7f435c158ca0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f436134c640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 0x7f435c151e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f43540b0040 tx=0x7f4354019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540b2050 con 0x7f435c158ca0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43540be070 con 0x7f435c158ca0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c1450e0 con 0x7f435c158ca0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540ada90 con 0x7f435c158ca0 2024-09-15T22:58:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1446a0 con 0x7f435c158ca0 2024-09-15T22:58:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.499+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f435c144bb0 con 0x7f435c158ca0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f43540adc30 con 0x7f435c158ca0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f43480678c0 0x7f4348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f43541215b0 con 0x7f435c158ca0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f4360b4b640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f43480678c0 0x7f4348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7f434806d780 0x7f434806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43540c5e70 con 0x7f434806d780 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4354121a40 con 0x7f435c158ca0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f435bfff640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7f434806d780 0x7f434806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f4360b4b640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f43480678c0 0x7f4348069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f434c000f70 tx=0x7f434c007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f435bfff640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7f434806d780 0x7f434806fba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.503+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== osd.1 v2:172.21.15.28:6808/3529915784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43540c5e70 con 0x7f434806d780 2024-09-15T22:58:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 --> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f435c069220 con 0x7f434806d780 2024-09-15T22:58:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f43597fa640 1 -- 172.21.15.28:0/160619530 <== osd.1 v2:172.21.15.28:6808/3529915784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f435c069220 con 0x7f434806d780 2024-09-15T22:58:22.522 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:22.522 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:22.522 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7f434806d780 msgr2=0x7f434806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6808/3529915784,v1:172.21.15.28:6809/3529915784] conn(0x7f434806d780 0x7f434806fba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f43480678c0 msgr2=0x7f4348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f43480678c0 0x7f4348069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f434c000f70 tx=0x7f434c007c10 comp rx=0 tx=0).stop 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 msgr2=0x7f435c151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.515+0000 7f4362daf640 1 --2- 172.21.15.28:0/160619530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f435c158ca0 0x7f435c151e20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f43540b0040 tx=0x7f4354019570 comp rx=0 tx=0).stop 2024-09-15T22:58:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.519+0000 7f436134c640 1 -- 172.21.15.28:0/160619530 reap_dead start 2024-09-15T22:58:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.519+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 shutdown_connections 2024-09-15T22:58:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.519+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 >> 172.21.15.28:0/160619530 conn(0x7f435c06bcc0 msgr2=0x7f435c152c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.519+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 shutdown_connections 2024-09-15T22:58:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.519+0000 7f4362daf640 1 -- 172.21.15.28:0/160619530 wait complete. 2024-09-15T22:58:22.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T22:58:22.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 Processor -- start 2024-09-15T22:58:22.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 -- start start 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e10145970 0x7f6e100b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e100d0960 con 0x7f6e100b2300 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6e100b2770 con 0x7f6e10145970 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e180f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100d0f20 con 0x7f6e100d0360 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e16695640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e15e94640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e10145970 0x7f6e100b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e16695640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:43582/0 (socket says 172.21.15.28:43582) 2024-09-15T22:58:22.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.643+0000 7f6e16695640 1 -- 172.21.15.28:0/2489266054 learned_addr learned my addr 172.21.15.28:0/2489266054 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e16695640 1 -- 172.21.15.28:0/2489266054 >> v2:172.21.15.131:3300/0 conn(0x7f6e10145970 msgr2=0x7f6e100b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e16695640 1 --2- 172.21.15.28:0/2489266054 >> v2:172.21.15.131:3300/0 conn(0x7f6e10145970 0x7f6e100b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e16695640 1 -- 172.21.15.28:0/2489266054 >> v1:172.21.15.131:6789/0 conn(0x7f6e100b2300 legacy=0x7f6e100cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e16695640 1 -- 172.21.15.28:0/2489266054 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e100d0c40 con 0x7f6e100d0360 2024-09-15T22:58:22.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e16695640 1 --2- 172.21.15.28:0/2489266054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009e80 tx=0x7f6e0801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8b6fff189f975f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e14e92640 1 -- 172.21.15.28:0/2489266054 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080a5750 con 0x7f6e100d0360 2024-09-15T22:58:22.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e14e92640 1 -- 172.21.15.28:0/2489266054 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e080a58f0 con 0x7f6e100d0360 2024-09-15T22:58:22.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e14e92640 1 -- 172.21.15.28:0/2489266054 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e080a5cc0 con 0x7f6e100d0360 2024-09-15T22:58:22.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 -- 172.21.15.28:0/2489266054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 msgr2=0x7f6e100cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2489266054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009e80 tx=0x7f6e0801c980 comp rx=0 tx=0).stop 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 -- 172.21.15.28:0/2489266054 shutdown_connections 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2489266054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100d0360 0x7f6e100cdab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2489266054 >> v2:172.21.15.131:3300/0 conn(0x7f6e10145970 0x7f6e100b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 -- 172.21.15.28:0/2489266054 >> 172.21.15.28:0/2489266054 conn(0x7f6e1006bcc0 msgr2=0x7f6e1006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 -- 172.21.15.28:0/2489266054 shutdown_connections 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.647+0000 7f6e180f8640 1 -- 172.21.15.28:0/2489266054 wait complete. 2024-09-15T22:58:22.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 Processor -- start 2024-09-15T22:58:22.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- start start 2024-09-15T22:58:22.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e100b2300 0x7f6e10073de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e10145970 0x7f6e10139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100ceb90 con 0x7f6e100d0360 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100cea10 con 0x7f6e100b2300 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100ced10 con 0x7f6e10145970 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36800/0 (socket says 172.21.15.28:36800) 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 -- 172.21.15.28:0/2637533088 learned_addr learned my addr 172.21.15.28:0/2637533088 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15e94640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e100b2300 0x7f6e10073de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e16695640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e10145970 0x7f6e10139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 -- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e10145970 msgr2=0x7f6e10139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e10145970 0x7f6e10139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 -- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e100b2300 msgr2=0x7f6e10073de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e100b2300 0x7f6e10073de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 -- 172.21.15.28:0/2637533088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e10072360 con 0x7f6e100d0360 2024-09-15T22:58:22.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e15693640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00c390 tx=0x7f6e0c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c017070 con 0x7f6e100d0360 2024-09-15T22:58:22.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0052f0 con 0x7f6e100d0360 2024-09-15T22:58:22.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e10072640 con 0x7f6e100d0360 2024-09-15T22:58:22.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c003840 con 0x7f6e100d0360 2024-09-15T22:58:22.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e10141c00 con 0x7f6e100d0360 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e100cdab0 con 0x7f6e100d0360 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e0c01a070 con 0x7f6e100d0360 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.651+0000 7f6e027fc640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 0x7f6df4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.655+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f6e0c084bd0 con 0x7f6e100d0360 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.655+0000 7f6e15e94640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 0x7f6df4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.655+0000 7f6e15e94640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 0x7f6df4069db0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009ac0 tx=0x7f6e04009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.659+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e0c0553c0 con 0x7f6e100d0360 2024-09-15T22:58:22.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.815+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6e1015bd10 con 0x7f6df40678f0 2024-09-15T22:58:22.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.815+0000 7f6e027fc640 1 -- 172.21.15.28:0/2637533088 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6e1015bd10 con 0x7f6df40678f0 2024-09-15T22:58:22.820 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T22:58:22.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 msgr2=0x7f6df4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 0x7f6df4069db0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009ac0 tx=0x7f6e04009190 comp rx=0 tx=0).stop 2024-09-15T22:58:22.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 msgr2=0x7f6e1015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00c390 tx=0x7f6e0c00c850 comp rx=0 tx=0).stop 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 shutdown_connections 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e10145970 0x7f6e10139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e100d0360 0x7f6e1015b7d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f6df40678f0 0x7f6df4069db0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 --2- 172.21.15.28:0/2637533088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e100b2300 0x7f6e10073de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 >> 172.21.15.28:0/2637533088 conn(0x7f6e1006bcc0 msgr2=0x7f6e1006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 shutdown_connections 2024-09-15T22:58:22.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.819+0000 7f6e180f8640 1 -- 172.21.15.28:0/2637533088 wait complete. 2024-09-15T22:58:22.838 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T22:58:22.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:22.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 Processor -- start 2024-09-15T22:58:22.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 -- start start 2024-09-15T22:58:22.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cc00cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc00cccf0 con 0x7f8cc015c9a0 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc00ccfd0 con 0x7f8cc00cf930 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc81e8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc015a440 con 0x7f8cc015a060 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc5783640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8cc015c9a0 0x7f8cc00cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45714/0 (socket says 172.21.15.28:45714) 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc5783640 1 -- 172.21.15.28:0/2678459022 learned_addr learned my addr 172.21.15.28:0/2678459022 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cc00cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300996216 0 0) 0x7f8cc00cccf0 con 0x7f8cc015c9a0 2024-09-15T22:58:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cac003530 con 0x7f8cc015c9a0 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 552561812 0 0) 0x7f8cac003530 con 0x7f8cc015c9a0 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 msgr2=0x7f8cc00cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cc00cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.947+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 >> v1:172.21.15.131:6789/0 conn(0x7f8cc00cf930 legacy=0x7f8cc015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc00cd2b0 con 0x7f8cc015c9a0 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f8cb0001680 con 0x7f8cc015c9a0 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 >> v1:172.21.15.28:6789/0 conn(0x7f8cc015c9a0 legacy=0x7f8cc00cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cac0039f0 0x7f8cac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac004810 0x7f8cac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc015a440 con 0x7f8cac0039f0 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac00ba80 con 0x7f8cac004810 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac00bc80 con 0x7f8cc015a060 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cac0039f0 0x7f8cac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5783640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac004810 0x7f8cac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc6785640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 -- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 msgr2=0x7f8cac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc015a060 0x7f8cac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 -- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac004810 msgr2=0x7f8cac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac004810 0x7f8cac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 -- 172.21.15.28:0/2678459022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac003530 con 0x7f8cac0039f0 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cac0039f0 0x7f8cac003e10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009a90 tx=0x7f8cbc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f783268128a135f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc009690 con 0x7f8cac0039f0 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cbc0a8450 con 0x7f8cac0039f0 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc4f82640 1 -- 172.21.15.28:0/2678459022 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0a8820 con 0x7f8cac0039f0 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 -- 172.21.15.28:0/2678459022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cac0039f0 msgr2=0x7f8cac003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 --2- 172.21.15.28:0/2678459022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cac0039f0 0x7f8cac003e10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009a90 tx=0x7f8cbc01ca10 comp rx=0 tx=0).stop 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc6785640 1 -- 172.21.15.28:0/2678459022 reap_dead start 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 -- 172.21.15.28:0/2678459022 shutdown_connections 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 -- 172.21.15.28:0/2678459022 >> 172.21.15.28:0/2678459022 conn(0x7f8cc006bcc0 msgr2=0x7f8cc006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 -- 172.21.15.28:0/2678459022 shutdown_connections 2024-09-15T22:58:22.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.951+0000 7f8cc81e8640 1 -- 172.21.15.28:0/2678459022 wait complete. 2024-09-15T22:58:22.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 Processor -- start 2024-09-15T22:58:22.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- start start 2024-09-15T22:58:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0039f0 0x7f8cc0150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc0150760 0x7f8cc01630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 0x7f8cc01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0168260 con 0x7f8cc0158170 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc01680e0 con 0x7f8cac0039f0 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc01683e0 con 0x7f8cc0150760 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 0x7f8cc01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 0x7f8cc01585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47312/0 (socket says 172.21.15.28:47312) 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 -- 172.21.15.28:0/3802917930 learned_addr learned my addr 172.21.15.28:0/3802917930 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0039f0 0x7f8cc0150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc5783640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc0150760 0x7f8cc01630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 -- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc0150760 msgr2=0x7f8cc01630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc0150760 0x7f8cc01630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 -- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0039f0 msgr2=0x7f8cc0150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0039f0 0x7f8cc0150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0157700 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0039f0 0x7f8cc0150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc6785640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 0x7f8cc01585f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e780 tx=0x7f8cb800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8003980 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb8018070 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc015f610 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8003d60 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc0157970 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cc0069220 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.955+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cb80050d0 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f8cb80856d0 con 0x7f8cc0158170 2024-09-15T22:58:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7f8ca406d780 0x7f8ca406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ca4070250 con 0x7f8ca406d780 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8cb808c050 con 0x7f8cc0158170 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cc5783640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7f8ca406d780 0x7f8ca406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cc5f84640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0af000 tx=0x7f8cbc0aa040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cc5783640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7f8ca406d780 0x7f8ca406fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:22.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.959+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== osd.2 v2:172.21.15.28:6816/1391193477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca4070250 con 0x7f8ca406d780 2024-09-15T22:58:22.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 --> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8cc015ff60 con 0x7f8ca406d780 2024-09-15T22:58:22.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cb67fc640 1 -- 172.21.15.28:0/3802917930 <== osd.2 v2:172.21.15.28:6816/1391193477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8cc015ff60 con 0x7f8ca406d780 2024-09-15T22:58:22.977 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:22.977 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:22.977 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7f8ca406d780 msgr2=0x7f8ca406fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6816/1391193477,v1:172.21.15.28:6817/1391193477] conn(0x7f8ca406d780 0x7f8ca406fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 msgr2=0x7f8ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f8ca40678c0 0x7f8ca4069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0af000 tx=0x7f8cbc0aa040 comp rx=0 tx=0).stop 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 msgr2=0x7f8cc01585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 --2- 172.21.15.28:0/3802917930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cc0158170 0x7f8cc01585f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e780 tx=0x7f8cb800ec40 comp rx=0 tx=0).stop 2024-09-15T22:58:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc6785640 1 -- 172.21.15.28:0/3802917930 reap_dead start 2024-09-15T22:58:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 shutdown_connections 2024-09-15T22:58:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 >> 172.21.15.28:0/3802917930 conn(0x7f8cc006bcc0 msgr2=0x7f8cc00722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 shutdown_connections 2024-09-15T22:58:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:22.971+0000 7f8cc81e8640 1 -- 172.21.15.28:0/3802917930 wait complete. 2024-09-15T22:58:22.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T22:58:23.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 Processor -- start 2024-09-15T22:58:23.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 -- start start 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22d415e370 0x7f22d40b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 0x7f22d40b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f22d40b5150 0x7f22d40aef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40b4780 con 0x7f22d415e370 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40b4450 con 0x7f22d40b5150 2024-09-15T22:58:23.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22da68a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40b3960 con 0x7f22d40cfa80 2024-09-15T22:58:23.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22d415e370 0x7f22d40b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22d415e370 0x7f22d40b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47318/0 (socket says 172.21.15.28:47318) 2024-09-15T22:58:23.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 -- 172.21.15.28:0/434717716 learned_addr learned my addr 172.21.15.28:0/434717716 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d37fe640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 0x7f22d40b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d8c27640 1 --2- 172.21.15.28:0/434717716 >> v2:172.21.15.131:3300/0 conn(0x7f22d40b5150 0x7f22d40aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 -- 172.21.15.28:0/434717716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 msgr2=0x7f22d40b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 0x7f22d40b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 -- 172.21.15.28:0/434717716 >> v2:172.21.15.131:3300/0 conn(0x7f22d40b5150 msgr2=0x7f22d40aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 --2- 172.21.15.28:0/434717716 >> v2:172.21.15.131:3300/0 conn(0x7f22d40b5150 0x7f22d40aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d3fff640 1 -- 172.21.15.28:0/434717716 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40b3c40 con 0x7f22d415e370 2024-09-15T22:58:23.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.095+0000 7f22d37fe640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 0x7f22d40b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:23.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22d3fff640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d40b3130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f22d4070d50 tx=0x7f22c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314d986cf56e8c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22d2ffd640 1 -- 172.21.15.28:0/434717716 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40b0070 con 0x7f22d415e370 2024-09-15T22:58:23.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22d2ffd640 1 -- 172.21.15.28:0/434717716 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c40ab600 con 0x7f22d415e370 2024-09-15T22:58:23.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22d2ffd640 1 -- 172.21.15.28:0/434717716 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40ab9d0 con 0x7f22d415e370 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 -- 172.21.15.28:0/434717716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 msgr2=0x7f22d40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d40b3130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f22d4070d50 tx=0x7f22c401c520 comp rx=0 tx=0).stop 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 -- 172.21.15.28:0/434717716 shutdown_connections 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 --2- 172.21.15.28:0/434717716 >> v2:172.21.15.131:3300/0 conn(0x7f22d40b5150 0x7f22d40aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40cfa80 0x7f22d40b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 --2- 172.21.15.28:0/434717716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d40b3130 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 -- 172.21.15.28:0/434717716 >> 172.21.15.28:0/434717716 conn(0x7f22d406bcc0 msgr2=0x7f22d406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 -- 172.21.15.28:0/434717716 shutdown_connections 2024-09-15T22:58:23.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.099+0000 7f22da68a640 1 -- 172.21.15.28:0/434717716 wait complete. 2024-09-15T22:58:23.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 Processor -- start 2024-09-15T22:58:23.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- start start 2024-09-15T22:58:23.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 0x7f22d414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d40cfa80 0x7f22d40b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40d0050 con 0x7f22d415e370 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40af870 con 0x7f22d40cfa80 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40d01d0 con 0x7f22d40b5150 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47334/0 (socket says 172.21.15.28:47334) 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 -- 172.21.15.28:0/1133848003 learned_addr learned my addr 172.21.15.28:0/1133848003 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d3fff640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 0x7f22d414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d37fe640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d40cfa80 0x7f22d40b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 -- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 msgr2=0x7f22d414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 0x7f22d414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 -- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d40cfa80 msgr2=0x7f22d40b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d40cfa80 0x7f22d40b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 -- 172.21.15.28:0/1133848003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d415b7e0 con 0x7f22d415e370 2024-09-15T22:58:23.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d3fff640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 0x7f22d414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d8c27640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007e40 tx=0x7f22cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc014620 con 0x7f22d415e370 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc019070 con 0x7f22d415e370 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d415bac0 con 0x7f22d415e370 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc014a20 con 0x7f22d415e370 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d415c080 con 0x7f22d415e370 2024-09-15T22:58:23.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d40b4bf0 con 0x7f22d415e370 2024-09-15T22:58:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22cc014bc0 con 0x7f22d415e370 2024-09-15T22:58:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 0x7f22c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d3fff640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 0x7f22c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.103+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f22cc086260 con 0x7f22d415e370 2024-09-15T22:58:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.107+0000 7f22d3fff640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 0x7f22c0069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22c40ad000 tx=0x7f22c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.111+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f22cc011260 con 0x7f22d415e370 2024-09-15T22:58:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f22d4159640 con 0x7f22c00678c0 2024-09-15T22:58:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22d0ff9640 1 -- 172.21.15.28:0/1133848003 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f22d4159640 con 0x7f22c00678c0 2024-09-15T22:58:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 msgr2=0x7f22c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 0x7f22c0069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22c40ad000 tx=0x7f22c4008040 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 msgr2=0x7f22d4151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f22cc007e40 tx=0x7f22cc00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 shutdown_connections 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22d415e370 0x7f22d4151260 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f22c00678c0 0x7f22c0069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22d40cfa80 0x7f22d40b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 --2- 172.21.15.28:0/1133848003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22d40b5150 0x7f22d414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 >> 172.21.15.28:0/1133848003 conn(0x7f22d406bcc0 msgr2=0x7f22d40afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 shutdown_connections 2024-09-15T22:58:23.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.271+0000 7f22da68a640 1 -- 172.21.15.28:0/1133848003 wait complete. 2024-09-15T22:58:23.294 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T22:58:23.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:23.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.399+0000 7faa8bfed640 1 Processor -- start 2024-09-15T22:58:23.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.399+0000 7faa8bfed640 1 -- start start 2024-09-15T22:58:23.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.399+0000 7faa8bfed640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 0x7faa840cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.399+0000 7faa8bfed640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 0x7faa840d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa8bfed640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa840cccf0 con 0x7faa840cf220 2024-09-15T22:58:23.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa8bfed640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa8415a440 con 0x7faa8415a060 2024-09-15T22:58:23.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa8bfed640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa840cfd60 con 0x7faa8415c9a0 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 0x7faa840d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89d89640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 0x7faa840cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89d89640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 0x7faa840cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:54216/0 (socket says 172.21.15.28:54216) 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa8a58a640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7faa840cf220 0x7faa840cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:59192/0 (socket says 172.21.15.28:59192) 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89d89640 1 -- 172.21.15.28:0/4279587404 learned_addr learned my addr 172.21.15.28:0/4279587404 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 -- 172.21.15.28:0/4279587404 >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 msgr2=0x7faa840cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 --2- 172.21.15.28:0/4279587404 >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 0x7faa840cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 -- 172.21.15.28:0/4279587404 >> v1:172.21.15.131:6789/0 conn(0x7faa840cf220 legacy=0x7faa840cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 -- 172.21.15.28:0/4279587404 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa840ccfd0 con 0x7faa8415c9a0 2024-09-15T22:58:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa89588640 1 --2- 172.21.15.28:0/4279587404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 0x7faa840d04d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa740097c0 tx=0x7faa7401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302376788fe09d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa88d87640 1 -- 172.21.15.28:0/4279587404 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740b0070 con 0x7faa8415c9a0 2024-09-15T22:58:23.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa88d87640 1 -- 172.21.15.28:0/4279587404 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa740ab600 con 0x7faa8415c9a0 2024-09-15T22:58:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.403+0000 7faa88d87640 1 -- 172.21.15.28:0/4279587404 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740ab9d0 con 0x7faa8415c9a0 2024-09-15T22:58:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/4279587404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 msgr2=0x7faa840d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- 172.21.15.28:0/4279587404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 0x7faa840d04d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa740097c0 tx=0x7faa7401c4a0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/4279587404 shutdown_connections 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- 172.21.15.28:0/4279587404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa8415c9a0 0x7faa840d04d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- 172.21.15.28:0/4279587404 >> v2:172.21.15.131:3300/0 conn(0x7faa8415a060 0x7faa840cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/4279587404 >> 172.21.15.28:0/4279587404 conn(0x7faa8406bcc0 msgr2=0x7faa8406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/4279587404 shutdown_connections 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/4279587404 wait complete. 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 Processor -- start 2024-09-15T22:58:23.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- start start 2024-09-15T22:58:23.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa840cf220 0x7faa841580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 0x7faa84150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8415c9a0 0x7faa84155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa84160b00 con 0x7faa8415a060 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa84160980 con 0x7faa8415c9a0 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa84160c80 con 0x7faa840cf220 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 0x7faa84150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 0x7faa84150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47342/0 (socket says 172.21.15.28:47342) 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 -- 172.21.15.28:0/2039180230 learned_addr learned my addr 172.21.15.28:0/2039180230 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89d89640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa840cf220 0x7faa841580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8a58a640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8415c9a0 0x7faa84155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 -- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa840cf220 msgr2=0x7faa841580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa840cf220 0x7faa841580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 -- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8415c9a0 msgr2=0x7faa84155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8415c9a0 0x7faa84155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa841567a0 con 0x7faa8415a060 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8a58a640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8415c9a0 0x7faa84155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa89588640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 0x7faa84150410 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa7401ab50 tx=0x7faa74019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740b0040 con 0x7faa8415a060 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa740bb070 con 0x7faa8415a060 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740b6670 con 0x7faa8415a060 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa84156a80 con 0x7faa8415a060 2024-09-15T22:58:23.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.407+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa84150950 con 0x7faa8415a060 2024-09-15T22:58:23.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa84069220 con 0x7faa8415a060 2024-09-15T22:58:23.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa740b3070 con 0x7faa8415a060 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa680678c0 0x7faa68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa89d89640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa680678c0 0x7faa68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7faa741200e0 con 0x7faa8415a060 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7faa6806d780 0x7faa6806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa740adec0 con 0x7faa6806d780 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7faa74120490 con 0x7faa8415a060 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa8a58a640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7faa6806d780 0x7faa6806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa89d89640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa680678c0 0x7faa68069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa840b0e80 tx=0x7faa80008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa8a58a640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7faa6806d780 0x7faa6806fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.411+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== osd.3 v2:172.21.15.28:6824/1666455377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa740adec0 con 0x7faa6806d780 2024-09-15T22:58:23.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 --> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa840cf650 con 0x7faa6806d780 2024-09-15T22:58:23.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa7a7fc640 1 -- 172.21.15.28:0/2039180230 <== osd.3 v2:172.21.15.28:6824/1666455377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faa840cf650 con 0x7faa6806d780 2024-09-15T22:58:23.430 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:23.430 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:23.430 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7faa6806d780 msgr2=0x7faa6806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6824/1666455377,v1:172.21.15.28:6825/1666455377] conn(0x7faa6806d780 0x7faa6806fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa680678c0 msgr2=0x7faa68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7faa680678c0 0x7faa68069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa840b0e80 tx=0x7faa80008040 comp rx=0 tx=0).stop 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 msgr2=0x7faa84150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.423+0000 7faa8bfed640 1 --2- 172.21.15.28:0/2039180230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8415a060 0x7faa84150410 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa7401ab50 tx=0x7faa74019240 comp rx=0 tx=0).stop 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.427+0000 7faa8a58a640 1 -- 172.21.15.28:0/2039180230 reap_dead start 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.427+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 shutdown_connections 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.427+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 >> 172.21.15.28:0/2039180230 conn(0x7faa8406bcc0 msgr2=0x7faa84153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.427+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 shutdown_connections 2024-09-15T22:58:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.427+0000 7faa8bfed640 1 -- 172.21.15.28:0/2039180230 wait complete. 2024-09-15T22:58:23.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T22:58:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 Processor -- start 2024-09-15T22:58:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 -- start start 2024-09-15T22:58:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99cc0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f99cc0b2300 0x7f99cc0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc0d0960 con 0x7f99cc0d0190 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f99cc0d0f20 con 0x7f99cc0b2300 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d3ed5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f99cc0cd620 con 0x7f99cc145970 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d2472640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f99cc0d0190 0x7f99cc072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45718/0 (socket says 172.21.15.28:45718) 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d2472640 1 -- 172.21.15.28:0/1040520678 learned_addr learned my addr 172.21.15.28:0/1040520678 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99cc0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d1470640 1 --2- 172.21.15.28:0/1040520678 >> v2:172.21.15.131:3300/0 conn(0x7f99cc0b2300 0x7f99cc0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549077013 0 0) 0x7f99cc0d0960 con 0x7f99cc0d0190 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b8003530 con 0x7f99cc0d0190 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1387130081 0 0) 0x7f99b8003530 con 0x7f99cc0d0190 2024-09-15T22:58:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 msgr2=0x7f99cc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99cc0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 >> v2:172.21.15.131:3300/0 conn(0x7f99cc0b2300 msgr2=0x7f99cc0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 --2- 172.21.15.28:0/1040520678 >> v2:172.21.15.131:3300/0 conn(0x7f99cc0b2300 0x7f99cc0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc0d0c40 con 0x7f99cc0d0190 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f99c4001a00 con 0x7f99cc0d0190 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 >> v1:172.21.15.28:6789/0 conn(0x7f99cc0d0190 legacy=0x7f99cc072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b8004810 0x7f99b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc0d0f20 con 0x7f99b80039c0 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.551+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc0cd620 con 0x7f99b8004810 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f99b800b9d0 con 0x7f99cc145970 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1470640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b8004810 0x7f99b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d2472640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 -- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 msgr2=0x7f99b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc145970 0x7f99b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 -- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b8004810 msgr2=0x7f99b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b8004810 0x7f99b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 -- 172.21.15.28:0/1040520678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b8003530 con 0x7f99b80039c0 2024-09-15T22:58:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1470640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b8004810 0x7f99b8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99b8003de0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009b10 tx=0x7f99c801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54849cba4a8a1ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c80096b0 con 0x7f99b80039c0 2024-09-15T22:58:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c80a9470 con 0x7f99b80039c0 2024-09-15T22:58:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d0c6f640 1 -- 172.21.15.28:0/1040520678 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c80a9860 con 0x7f99b80039c0 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1040520678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 msgr2=0x7f99b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1040520678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99b8003de0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009b10 tx=0x7f99c801ca70 comp rx=0 tx=0).stop 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d2472640 1 -- 172.21.15.28:0/1040520678 reap_dead start 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1040520678 shutdown_connections 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1040520678 >> 172.21.15.28:0/1040520678 conn(0x7f99cc06bcc0 msgr2=0x7f99cc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1040520678 shutdown_connections 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.555+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1040520678 wait complete. 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 Processor -- start 2024-09-15T22:58:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- start start 2024-09-15T22:58:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99cc1f54c0 0x7f99cc143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 0x7f99cc0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc166e50 con 0x7f99b80039c0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc073140 con 0x7f99cc1f54c0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f99cc166fd0 con 0x7f99cc143ca0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47346/0 (socket says 172.21.15.28:47346) 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 -- 172.21.15.28:0/1229026186 learned_addr learned my addr 172.21.15.28:0/1229026186 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d2472640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 0x7f99cc0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 -- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 msgr2=0x7f99cc0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 0x7f99cc0af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1470640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99cc1f54c0 0x7f99cc143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 -- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99cc1f54c0 msgr2=0x7f99cc143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99cc1f54c0 0x7f99cc143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 -- 172.21.15.28:0/1229026186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc0aa6f0 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d2472640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 0x7f99cc0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1c71640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009b10 tx=0x7f99b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c80c0070 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c800f000 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99cc0aa9d0 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c80a9e40 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99cc0aaf90 con 0x7f99b80039c0 2024-09-15T22:58:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99cc0cfc50 con 0x7f99b80039c0 2024-09-15T22:58:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99c80ba3f0 con 0x7f99b80039c0 2024-09-15T22:58:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99c27fc640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 0x7f99b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.559+0000 7f99d1470640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 0x7f99b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.563+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f99c811f570 con 0x7f99b80039c0 2024-09-15T22:58:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.563+0000 7f99d1470640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 0x7f99b0069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99cc136230 tx=0x7f99bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.567+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99c80ad020 con 0x7f99b80039c0 2024-09-15T22:58:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.731+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f99cc144080 con 0x7f99b00678c0 2024-09-15T22:58:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.731+0000 7f99c27fc640 1 -- 172.21.15.28:0/1229026186 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f99cc144080 con 0x7f99b00678c0 2024-09-15T22:58:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 msgr2=0x7f99b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 0x7f99b0069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99cc136230 tx=0x7f99bc008040 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 msgr2=0x7f99cc135950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009b10 tx=0x7f99b8005840 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 shutdown_connections 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99cc143ca0 0x7f99cc0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f99b00678c0 0x7f99b0069d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99cc1f54c0 0x7f99cc143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 --2- 172.21.15.28:0/1229026186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99b80039c0 0x7f99cc135950 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 >> 172.21.15.28:0/1229026186 conn(0x7f99cc06bcc0 msgr2=0x7f99cc0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 shutdown_connections 2024-09-15T22:58:23.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.735+0000 7f99d3ed5640 1 -- 172.21.15.28:0/1229026186 wait complete. 2024-09-15T22:58:23.755 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T22:58:23.755 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 Processor -- start 2024-09-15T22:58:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 -- start start 2024-09-15T22:58:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0ac158ca0 0x7fb0ac0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0cff80 0x7fb0ac0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ac0ce0c0 con 0x7fb0ac06cdd0 2024-09-15T22:58:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb0ac0cdc60 con 0x7fb0ac158ca0 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b3f37640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac0cecd0 con 0x7fb0ac0cff80 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0ac158ca0 0x7fb0ac0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0ac158ca0 0x7fb0ac0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47358/0 (socket says 172.21.15.28:47358) 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 -- 172.21.15.28:0/4136056838 learned_addr learned my addr 172.21.15.28:0/4136056838 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b14d2640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0cff80 0x7fb0ac0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 -- 172.21.15.28:0/4136056838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0cff80 msgr2=0x7fb0ac0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0cff80 0x7fb0ac0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 -- 172.21.15.28:0/4136056838 >> v1:172.21.15.131:6789/0 conn(0x7fb0ac06cdd0 legacy=0x7fb0ac06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.871+0000 7fb0b1cd3640 1 -- 172.21.15.28:0/4136056838 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac0ce3a0 con 0x7fb0ac158ca0 2024-09-15T22:58:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b1cd3640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac0af030 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009e50 tx=0x7fb0a801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cd229225fe0266 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b0cd1640 1 -- 172.21.15.28:0/4136056838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5640 con 0x7fb0ac158ca0 2024-09-15T22:58:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b0cd1640 1 -- 172.21.15.28:0/4136056838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a80a57e0 con 0x7fb0ac158ca0 2024-09-15T22:58:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b0cd1640 1 -- 172.21.15.28:0/4136056838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5bb0 con 0x7fb0ac158ca0 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 -- 172.21.15.28:0/4136056838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 msgr2=0x7fb0ac0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac0af030 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009e50 tx=0x7fb0a801c8d0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 -- 172.21.15.28:0/4136056838 shutdown_connections 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac0cff80 0x7fb0ac0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/4136056838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac0af030 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 -- 172.21.15.28:0/4136056838 >> 172.21.15.28:0/4136056838 conn(0x7fb0ac06bcc0 msgr2=0x7fb0ac06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 -- 172.21.15.28:0/4136056838 shutdown_connections 2024-09-15T22:58:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.875+0000 7fb0b3f37640 1 -- 172.21.15.28:0/4136056838 wait complete. 2024-09-15T22:58:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 Processor -- start 2024-09-15T22:58:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- start start 2024-09-15T22:58:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac06cdd0 0x7fb0ac152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0cff80 0x7fb0ac0728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac0af6f0 con 0x7fb0ac158ca0 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac0af570 con 0x7fb0ac0cff80 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ac0aea00 con 0x7fb0ac06cdd0 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac14ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47368/0 (socket says 172.21.15.28:47368) 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 -- 172.21.15.28:0/917285578 learned_addr learned my addr 172.21.15.28:0/917285578 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b1cd3640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac06cdd0 0x7fb0ac152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b14d2640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0cff80 0x7fb0ac0728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 -- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac06cdd0 msgr2=0x7fb0ac152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb0ac06cdd0 0x7fb0ac152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 -- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0cff80 msgr2=0x7fb0ac0728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0ac0cff80 0x7fb0ac0728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac073020 con 0x7fb0ac158ca0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b24d4640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac14ec90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b410 tx=0x7fb0a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4015020 con 0x7fb0ac158ca0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a4011870 con 0x7fb0ac158ca0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac073300 con 0x7fb0ac158ca0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4011c60 con 0x7fb0ac158ca0 2024-09-15T22:58:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.879+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac14f1d0 con 0x7fb0ac158ca0 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0ac069220 con 0x7fb0ac158ca0 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0a4018020 con 0x7fb0ac158ca0 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb0900678c0 0x7fb090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fb0a4085a80 con 0x7fb0ac158ca0 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7fb09006d780 0x7fb09006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0b1cd3640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb0900678c0 0x7fb090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb090070250 con 0x7fb09006d780 2024-09-15T22:58:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb0a4085e30 con 0x7fb0ac158ca0 2024-09-15T22:58:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0b14d2640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7fb09006d780 0x7fb09006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0b1cd3640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb0900678c0 0x7fb090069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80ae000 tx=0x7fb0a80a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.883+0000 7fb0b14d2640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7fb09006d780 0x7fb09006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.887+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== osd.4 v2:172.21.15.131:6800/3878671609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb090070250 con 0x7fb09006d780 2024-09-15T22:58:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 --> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb0ac073820 con 0x7fb09006d780 2024-09-15T22:58:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0a27fc640 1 -- 172.21.15.28:0/917285578 <== osd.4 v2:172.21.15.131:6800/3878671609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb0ac073820 con 0x7fb09006d780 2024-09-15T22:58:23.905 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:23.905 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:23.905 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7fb09006d780 msgr2=0x7fb09006fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.131:6800/3878671609,v1:172.21.15.131:6801/3878671609] conn(0x7fb09006d780 0x7fb09006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb0900678c0 msgr2=0x7fb090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb0900678c0 0x7fb090069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80ae000 tx=0x7fb0a80a7070 comp rx=0 tx=0).stop 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 msgr2=0x7fb0ac14ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 --2- 172.21.15.28:0/917285578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0ac158ca0 0x7fb0ac14ec90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b410 tx=0x7fb0a400b8d0 comp rx=0 tx=0).stop 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b24d4640 1 -- 172.21.15.28:0/917285578 reap_dead start 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 shutdown_connections 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 >> 172.21.15.28:0/917285578 conn(0x7fb0ac06bcc0 msgr2=0x7fb0ac0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 shutdown_connections 2024-09-15T22:58:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:23.899+0000 7fb0b3f37640 1 -- 172.21.15.28:0/917285578 wait complete. 2024-09-15T22:58:23.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T22:58:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 Processor -- start 2024-09-15T22:58:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 -- start start 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f822015e680 0x7f82200d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f82200cfb50 0x7f8220162ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82200ced90 con 0x7f82200d0fb0 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f82200cf070 con 0x7f822015e680 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f822528c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f82200cf350 con 0x7f82200cfb50 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f822015e680 0x7f82200d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f822015e680 0x7f82200d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47372/0 (socket says 172.21.15.28:47372) 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 -- 172.21.15.28:0/3854192140 learned_addr learned my addr 172.21.15.28:0/3854192140 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821e7fc640 1 --2- 172.21.15.28:0/3854192140 >> v2:172.21.15.131:3300/0 conn(0x7f82200cfb50 0x7f8220162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 -- 172.21.15.28:0/3854192140 >> v2:172.21.15.131:3300/0 conn(0x7f82200cfb50 msgr2=0x7f8220162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 --2- 172.21.15.28:0/3854192140 >> v2:172.21.15.131:3300/0 conn(0x7f82200cfb50 0x7f8220162ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 -- 172.21.15.28:0/3854192140 >> v1:172.21.15.131:6789/0 conn(0x7f82200d0fb0 legacy=0x7f82200b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.039+0000 7f821effd640 1 -- 172.21.15.28:0/3854192140 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82200cf630 con 0x7f822015e680 2024-09-15T22:58:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f821effd640 1 --2- 172.21.15.28:0/3854192140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f822015e680 0x7f82200d2330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f82200b75c0 tx=0x7f821001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf81de3b7046150a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f821dffb640 1 -- 172.21.15.28:0/3854192140 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b0070 con 0x7f822015e680 2024-09-15T22:58:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f821dffb640 1 -- 172.21.15.28:0/3854192140 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82100ab600 con 0x7f822015e680 2024-09-15T22:58:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f821dffb640 1 -- 172.21.15.28:0/3854192140 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100ab9d0 con 0x7f822015e680 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- 172.21.15.28:0/3854192140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f822015e680 msgr2=0x7f82200d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- 172.21.15.28:0/3854192140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f822015e680 0x7f82200d2330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f82200b75c0 tx=0x7f821001c4e0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- 172.21.15.28:0/3854192140 shutdown_connections 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- 172.21.15.28:0/3854192140 >> v2:172.21.15.131:3300/0 conn(0x7f82200cfb50 0x7f8220162ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- 172.21.15.28:0/3854192140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f822015e680 0x7f82200d2330 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- 172.21.15.28:0/3854192140 >> 172.21.15.28:0/3854192140 conn(0x7f822006c360 msgr2=0x7f822006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- 172.21.15.28:0/3854192140 shutdown_connections 2024-09-15T22:58:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- 172.21.15.28:0/3854192140 wait complete. 2024-09-15T22:58:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 Processor -- start 2024-09-15T22:58:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- start start 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82200d0fb0 0x7f822015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f822015e680 0x7f82200ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f822016b730 con 0x7f82200cfb50 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f822016b5b0 con 0x7f82200d0fb0 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.043+0000 7f822528c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f822016b8b0 con 0x7f822015e680 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47374/0 (socket says 172.21.15.28:47374) 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 -- 172.21.15.28:0/981458780 learned_addr learned my addr 172.21.15.28:0/981458780 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 -- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f822015e680 msgr2=0x7f82200ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821e7fc640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82200d0fb0 0x7f822015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821f7fe640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f822015e680 0x7f82200ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f822015e680 0x7f82200ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 -- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82200d0fb0 msgr2=0x7f822015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82200d0fb0 0x7f822015a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 -- 172.21.15.28:0/981458780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822015b390 con 0x7f82200cfb50 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821effd640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f82100ae040 tx=0x7f821001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b0040 con 0x7f82200cfb50 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82100bc070 con 0x7f82200cfb50 2024-09-15T22:58:24.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822015b670 con 0x7f82200cfb50 2024-09-15T22:58:24.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100b6660 con 0x7f82200cfb50 2024-09-15T22:58:24.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82200c8250 con 0x7f82200cfb50 2024-09-15T22:58:24.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82200ba520 con 0x7f82200cfb50 2024-09-15T22:58:24.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82100b6800 con 0x7f82200cfb50 2024-09-15T22:58:24.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 0x7f820c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f821011fd70 con 0x7f82200cfb50 2024-09-15T22:58:24.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821e7fc640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 0x7f820c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.047+0000 7f821e7fc640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 0x7f820c069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f82200ccb60 tx=0x7f8214008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.051+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f82100160d0 con 0x7f82200cfb50 2024-09-15T22:58:24.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f82200c8490 con 0x7f820c0678c0 2024-09-15T22:58:24.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f82077fe640 1 -- 172.21.15.28:0/981458780 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f821400e510 con 0x7f820c0678c0 2024-09-15T22:58:24.216 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 msgr2=0x7f820c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 0x7f820c069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f82200ccb60 tx=0x7f8214008040 comp rx=0 tx=0).stop 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 msgr2=0x7f8220156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f82100ae040 tx=0x7f821001ad20 comp rx=0 tx=0).stop 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 shutdown_connections 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f822015e680 0x7f82200ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f820c0678c0 0x7f820c069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82200d0fb0 0x7f822015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 --2- 172.21.15.28:0/981458780 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82200cfb50 0x7f8220156c50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 >> 172.21.15.28:0/981458780 conn(0x7f822006c360 msgr2=0x7f82200b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 shutdown_connections 2024-09-15T22:58:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.211+0000 7f822528c640 1 -- 172.21.15.28:0/981458780 wait complete. 2024-09-15T22:58:24.233 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T22:58:24.234 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:24.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 Processor -- start 2024-09-15T22:58:24.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 -- start start 2024-09-15T22:58:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fecec0d0730 0x7fecec165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecec15c0c0 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecec15c3a0 con 0x7fecec0b3480 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf3443640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fecec0ce1a0 con 0x7fecec0d0730 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf11df640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fecec155a40 0x7fecec15b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45720/0 (socket says 172.21.15.28:45720) 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf11df640 1 -- 172.21.15.28:0/988644264 learned_addr learned my addr 172.21.15.28:0/988644264 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747725844 0 0) 0x7fecec15c0c0 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd8003530 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf19e0640 1 --2- 172.21.15.28:0/988644264 >> v2:172.21.15.131:3300/0 conn(0x7fecec0d0730 0x7fecec165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2084822310 0 0) 0x7fecd8003530 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 >> v2:172.21.15.131:3300/0 conn(0x7fecec0d0730 msgr2=0x7fecec165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 --2- 172.21.15.28:0/988644264 >> v2:172.21.15.131:3300/0 conn(0x7fecec0d0730 0x7fecec165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 >> v1:172.21.15.131:6789/0 conn(0x7fecec0b3480 legacy=0x7fecec0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec15c680 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fece8001680 con 0x7fecec155a40 2024-09-15T22:58:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 >> v1:172.21.15.28:6789/0 conn(0x7fecec155a40 legacy=0x7fecec15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecd80039c0 0x7fecd8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecd8005220 0x7fecd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecec0ce1a0 con 0x7fecd8004810 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fecd800c150 con 0x7fecd80039c0 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fecd800c350 con 0x7fecd8005220 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.351+0000 7fecf19e0640 1 --2- 172.21.15.28:0/988644264 >> v2:172.21.15.131:3300/0 conn(0x7fecec0d0730 0x7fecec165f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf11df640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecd80039c0 0x7fecd8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 -- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecd8005220 msgr2=0x7fecd800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecd8005220 0x7fecd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 -- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecd80039c0 msgr2=0x7fecd8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecd80039c0 0x7fecd8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 -- 172.21.15.28:0/988644264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd8003530 con 0x7fecd8004810 2024-09-15T22:58:24.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf19e0640 1 -- 172.21.15.28:0/988644264 reap_dead start 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf09de640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecd8004c90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fecdc001780 tx=0x7fecdc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f1a84e6afd8aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0013a0 con 0x7fecd8004810 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecdc0052f0 con 0x7fecd8004810 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fece3fff640 1 -- 172.21.15.28:0/988644264 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc003840 con 0x7fecd8004810 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 -- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 msgr2=0x7fecd8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecd8004c90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fecdc001780 tx=0x7fecdc01c400 comp rx=0 tx=0).stop 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 -- 172.21.15.28:0/988644264 shutdown_connections 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 --2- 172.21.15.28:0/988644264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecd8004c90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 -- 172.21.15.28:0/988644264 >> 172.21.15.28:0/988644264 conn(0x7fecec06bcc0 msgr2=0x7fecec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 -- 172.21.15.28:0/988644264 shutdown_connections 2024-09-15T22:58:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.355+0000 7fecf3443640 1 -- 172.21.15.28:0/988644264 wait complete. 2024-09-15T22:58:24.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 Processor -- start 2024-09-15T22:58:24.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- start start 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecec1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecec1368e0 0x7fecec0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecec136d60 0x7fecec0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecec0d03b0 con 0x7fecd8004810 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fecec0d0230 con 0x7fecec1368e0 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fecec0d0530 con 0x7fecec136d60 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecec1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecec1f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47392/0 (socket says 172.21.15.28:47392) 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 -- 172.21.15.28:0/253540260 learned_addr learned my addr 172.21.15.28:0/253540260 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf09de640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecec1368e0 0x7fecec0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf19e0640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecec136d60 0x7fecec0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 -- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecec136d60 msgr2=0x7fecec0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecec136d60 0x7fecec0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 -- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecec1368e0 msgr2=0x7fecec0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecec1368e0 0x7fecec0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec156a10 con 0x7fecd8004810 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf11df640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecec1f8890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fece80117f0 tx=0x7fece8011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8010040 con 0x7fecd8004810 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece801a070 con 0x7fecd8004810 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec156cf0 con 0x7fecd8004810 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece800fd80 con 0x7fecd8004810 2024-09-15T22:58:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec1572b0 con 0x7fecd8004810 2024-09-15T22:58:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecec069220 con 0x7fecd8004810 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.359+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fece801f460 con 0x7fecd8004810 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fecd00678f0 0x7fecd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fece80894f0 con 0x7fecd8004810 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fecf09de640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fecd00678f0 0x7fecd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7fecd006d7b0 0x7fecd006fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecd0070280 con 0x7fecd006d7b0 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fece8089980 con 0x7fecd8004810 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fecf09de640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fecd00678f0 0x7fecd0069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecdc001750 tx=0x7fecdc0011a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fecf19e0640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7fecd006d7b0 0x7fecd006fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fecf19e0640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7fecd006d7b0 0x7fecd006fbd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.363+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== osd.5 v2:172.21.15.131:6808/1626453744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecd0070280 con 0x7fecd006d7b0 2024-09-15T22:58:24.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 --> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecec15b8d0 con 0x7fecd006d7b0 2024-09-15T22:58:24.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fece1ffb640 1 -- 172.21.15.28:0/253540260 <== osd.5 v2:172.21.15.131:6808/1626453744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecec15b8d0 con 0x7fecd006d7b0 2024-09-15T22:58:24.383 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:24.383 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:24.383 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:24.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7fecd006d7b0 msgr2=0x7fecd006fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.131:6808/1626453744,v1:172.21.15.131:6809/1626453744] conn(0x7fecd006d7b0 0x7fecd006fbd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fecd00678f0 msgr2=0x7fecd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fecd00678f0 0x7fecd0069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecdc001750 tx=0x7fecdc0011a0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 msgr2=0x7fecec1f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 --2- 172.21.15.28:0/253540260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd8004810 0x7fecec1f8890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fece80117f0 tx=0x7fece8011cb0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf19e0640 1 -- 172.21.15.28:0/253540260 reap_dead start 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 shutdown_connections 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 >> 172.21.15.28:0/253540260 conn(0x7fecec06bcc0 msgr2=0x7fecec14be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 shutdown_connections 2024-09-15T22:58:24.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.379+0000 7fecf3443640 1 -- 172.21.15.28:0/253540260 wait complete. 2024-09-15T22:58:24.400 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T22:58:24.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 Processor -- start 2024-09-15T22:58:24.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 -- start start 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 0x7fd3840b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3840b2300 0x7fd3840cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3840d0960 con 0x7fd3840d0190 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd3840d0f20 con 0x7fd3840b2300 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3892fc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd3840cd620 con 0x7fd384145970 2024-09-15T22:58:24.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3837fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd3840d0190 0x7fd384072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45730/0 (socket says 172.21.15.28:45730) 2024-09-15T22:58:24.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3837fe640 1 -- 172.21.15.28:0/3447429730 learned_addr learned my addr 172.21.15.28:0/3447429730 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:24.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd382ffd640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 0x7fd3840b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd3827fc640 1 --2- 172.21.15.28:0/3447429730 >> v2:172.21.15.131:3300/0 conn(0x7fd3840b2300 0x7fd3840cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748464533 0 0) 0x7fd3840d0960 con 0x7fd3840d0190 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36c003530 con 0x7fd3840d0190 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1385087368 0 0) 0x7fd36c003530 con 0x7fd3840d0190 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 msgr2=0x7fd3840b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.511+0000 7fd381ffb640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 0x7fd3840b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 >> v2:172.21.15.131:3300/0 conn(0x7fd3840b2300 msgr2=0x7fd3840cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 --2- 172.21.15.28:0/3447429730 >> v2:172.21.15.131:3300/0 conn(0x7fd3840b2300 0x7fd3840cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3840d0c40 con 0x7fd3840d0190 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fd37c001a00 con 0x7fd3840d0190 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 >> v1:172.21.15.28:6789/0 conn(0x7fd3840d0190 legacy=0x7fd384072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd36c0039c0 0x7fd36c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd36c004810 0x7fd36c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 0x7fd36c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840d0f20 con 0x7fd36c004810 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3840cd620 con 0x7fd36c0039c0 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c00b9d0 con 0x7fd384145970 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd36c004810 0x7fd36c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd382ffd640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd36c0039c0 0x7fd36c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 -- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 msgr2=0x7fd36c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd384145970 0x7fd36c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 -- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd36c0039c0 msgr2=0x7fd36c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd36c0039c0 0x7fd36c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 -- 172.21.15.28:0/3447429730 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c003530 con 0x7fd36c004810 2024-09-15T22:58:24.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd382ffd640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd36c0039c0 0x7fd36c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:24.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3827fc640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd36c004810 0x7fd36c004c90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd378009b10 tx=0x7fd37801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78fbefb7e4ba6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780096b0 con 0x7fd36c004810 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780a8430 con 0x7fd36c004810 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd381ffb640 1 -- 172.21.15.28:0/3447429730 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a8820 con 0x7fd36c004810 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 -- 172.21.15.28:0/3447429730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd36c004810 msgr2=0x7fd36c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 --2- 172.21.15.28:0/3447429730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd36c004810 0x7fd36c004c90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd378009b10 tx=0x7fd37801cab0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3837fe640 1 -- 172.21.15.28:0/3447429730 reap_dead start 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 -- 172.21.15.28:0/3447429730 shutdown_connections 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 -- 172.21.15.28:0/3447429730 >> 172.21.15.28:0/3447429730 conn(0x7fd38406bcc0 msgr2=0x7fd38406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 -- 172.21.15.28:0/3447429730 shutdown_connections 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.515+0000 7fd3892fc640 1 -- 172.21.15.28:0/3447429730 wait complete. 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 Processor -- start 2024-09-15T22:58:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- start start 2024-09-15T22:58:24.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd36c004810 0x7fd384142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 0x7fd38406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd384166e50 con 0x7fd3841f8240 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd384073140 con 0x7fd38406d170 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd384166fd0 con 0x7fd36c004810 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47412/0 (socket says 172.21.15.28:47412) 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 -- 172.21.15.28:0/1319779970 learned_addr learned my addr 172.21.15.28:0/1319779970 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd382ffd640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd36c004810 0x7fd384142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3837fe640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 0x7fd38406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 -- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd36c004810 msgr2=0x7fd384142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd36c004810 0x7fd384142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 -- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 msgr2=0x7fd38406d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 0x7fd38406d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 -- 172.21.15.28:0/1319779970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3840ae8b0 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3837fe640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 0x7fd38406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3827fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd37801c8e0 tx=0x7fd378019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a8c60 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780a8e00 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3840aeb90 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780bc670 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3841f7a40 con 0x7fd3841f8240 2024-09-15T22:58:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3840cfc50 con 0x7fd3841f8240 2024-09-15T22:58:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.519+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3780bc810 con 0x7fd3841f8240 2024-09-15T22:58:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.523+0000 7fd36b7fe640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 0x7fd370069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.523+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fd37811ff70 con 0x7fd3841f8240 2024-09-15T22:58:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.523+0000 7fd382ffd640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 0x7fd370069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.523+0000 7fd382ffd640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 0x7fd370069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3740099e0 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.527+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd3780ac030 con 0x7fd3841f8240 2024-09-15T22:58:24.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.683+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd384143310 con 0x7fd3700678c0 2024-09-15T22:58:24.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.683+0000 7fd36b7fe640 1 -- 172.21.15.28:0/1319779970 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd374004020 con 0x7fd3700678c0 2024-09-15T22:58:24.690 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T22:58:24.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 msgr2=0x7fd370069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 0x7fd370069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3740099e0 tx=0x7fd374008040 comp rx=0 tx=0).stop 2024-09-15T22:58:24.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 msgr2=0x7fd3840af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd37801c8e0 tx=0x7fd378019850 comp rx=0 tx=0).stop 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 shutdown_connections 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fd3700678c0 0x7fd370069d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd38406d170 0x7fd38406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3841f8240 0x7fd3840af3c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 --2- 172.21.15.28:0/1319779970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd36c004810 0x7fd384142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 >> 172.21.15.28:0/1319779970 conn(0x7fd38406bcc0 msgr2=0x7fd3841445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 shutdown_connections 2024-09-15T22:58:24.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.687+0000 7fd3892fc640 1 -- 172.21.15.28:0/1319779970 wait complete. 2024-09-15T22:58:24.708 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T22:58:24.709 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:24.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 Processor -- start 2024-09-15T22:58:24.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 -- start start 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb29c0cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29c0cccf0 con 0x7fb29c15c9a0 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29c0ccfd0 con 0x7fb29c15a060 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a3a9d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c15a440 con 0x7fb29c0d06a0 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a1038640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb29c15c9a0 0x7fb29c0cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45742/0 (socket says 172.21.15.28:45742) 2024-09-15T22:58:24.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a1038640 1 -- 172.21.15.28:0/1500998025 learned_addr learned my addr 172.21.15.28:0/1500998025 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a203a640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb29c0cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411212295 0 0) 0x7fb29c0cccf0 con 0x7fb29c15c9a0 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb288003530 con 0x7fb29c15c9a0 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 239303107 0 0) 0x7fb288003530 con 0x7fb29c15c9a0 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 msgr2=0x7fb29c0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb29c0cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 >> v1:172.21.15.131:6789/0 conn(0x7fb29c15a060 legacy=0x7fb29c0cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c0cd2b0 con 0x7fb29c15c9a0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.831+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7fb28c001680 con 0x7fb29c15c9a0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 >> v1:172.21.15.28:6789/0 conn(0x7fb29c15c9a0 legacy=0x7fb29c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb288003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb288004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb288004d50 0x7fb2880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c15a440 con 0x7fb2880039f0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb28800bab0 con 0x7fb288004d50 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb28800bcb0 con 0x7fb29c0d06a0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb288003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1038640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb288004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a203a640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb288004d50 0x7fb2880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 -- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 msgr2=0x7fb288004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb288004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 -- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb288004d50 msgr2=0x7fb2880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:24.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb288004d50 0x7fb2880051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 -- 172.21.15.28:0/1500998025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb288003530 con 0x7fb2880039f0 2024-09-15T22:58:24.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1038640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0d06a0 0x7fb288004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb288003e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb298001750 tx=0x7fb29801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323e0982c4cd7fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980013a0 con 0x7fb2880039f0 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2980052f0 con 0x7fb2880039f0 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a0837640 1 -- 172.21.15.28:0/1500998025 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298003840 con 0x7fb2880039f0 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1500998025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 msgr2=0x7fb288003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 --2- 172.21.15.28:0/1500998025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb288003e10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb298001750 tx=0x7fb29801c3e0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a203a640 1 -- 172.21.15.28:0/1500998025 reap_dead start 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1500998025 shutdown_connections 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1500998025 >> 172.21.15.28:0/1500998025 conn(0x7fb29c06bcc0 msgr2=0x7fb29c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1500998025 shutdown_connections 2024-09-15T22:58:24.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.835+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1500998025 wait complete. 2024-09-15T22:58:24.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 Processor -- start 2024-09-15T22:58:24.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- start start 2024-09-15T22:58:24.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb29c158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb29c159120 0x7fb29c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0b43c0 0x7fb29c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c167c70 con 0x7fb2880039f0 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c167af0 con 0x7fb29c159120 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c167df0 con 0x7fb29c0b43c0 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb29c158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb29c158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47432/0 (socket says 172.21.15.28:47432) 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 -- 172.21.15.28:0/1537080818 learned_addr learned my addr 172.21.15.28:0/1537080818 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1038640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb29c159120 0x7fb29c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a203a640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0b43c0 0x7fb29c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 -- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0b43c0 msgr2=0x7fb29c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb29c0b43c0 0x7fb29c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 -- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb29c159120 msgr2=0x7fb29c14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb29c159120 0x7fb29c14c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c0b4d80 con 0x7fb2880039f0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a1839640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb29c158160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb298005040 tx=0x7fb288005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298007a40 con 0x7fb2880039f0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2980bb070 con 0x7fb2880039f0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29c15e5f0 con 0x7fb2880039f0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980013a0 con 0x7fb2880039f0 2024-09-15T22:58:24.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29c15eb70 con 0x7fb2880039f0 2024-09-15T22:58:24.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb29c069220 con 0x7fb2880039f0 2024-09-15T22:58:24.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.839+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2980b4040 con 0x7fb2880039f0 2024-09-15T22:58:24.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb2800678c0 0x7fb280069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fb298120730 con 0x7fb2880039f0 2024-09-15T22:58:24.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2a1038640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb2800678c0 0x7fb280069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7fb28006d780 0x7fb28006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb280070250 con 0x7fb28006d780 2024-09-15T22:58:24.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb298120bc0 con 0x7fb2880039f0 2024-09-15T22:58:24.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2a1038640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb2800678c0 0x7fb280069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0017f0 tx=0x7fb28c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2a203a640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7fb28006d780 0x7fb28006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:24.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2a203a640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7fb28006d780 0x7fb28006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:24.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.843+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== osd.6 v2:172.21.15.131:6816/1452359043 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb280070250 con 0x7fb28006d780 2024-09-15T22:58:24.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 --> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb29c0cff90 con 0x7fb28006d780 2024-09-15T22:58:24.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2927fc640 1 -- 172.21.15.28:0/1537080818 <== osd.6 v2:172.21.15.131:6816/1452359043 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb29c0cff90 con 0x7fb28006d780 2024-09-15T22:58:24.864 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:24.864 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:24.864 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7fb28006d780 msgr2=0x7fb28006fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.131:6816/1452359043,v1:172.21.15.131:6817/1452359043] conn(0x7fb28006d780 0x7fb28006fba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb2800678c0 msgr2=0x7fb280069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fb2800678c0 0x7fb280069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0017f0 tx=0x7fb28c009040 comp rx=0 tx=0).stop 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 msgr2=0x7fb29c158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 --2- 172.21.15.28:0/1537080818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb2880039f0 0x7fb29c158160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb298005040 tx=0x7fb288005840 comp rx=0 tx=0).stop 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a203a640 1 -- 172.21.15.28:0/1537080818 reap_dead start 2024-09-15T22:58:24.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 shutdown_connections 2024-09-15T22:58:24.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 >> 172.21.15.28:0/1537080818 conn(0x7fb29c06bcc0 msgr2=0x7fb29c1541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:24.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 shutdown_connections 2024-09-15T22:58:24.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.859+0000 7fb2a3a9d640 1 -- 172.21.15.28:0/1537080818 wait complete. 2024-09-15T22:58:24.880 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T22:58:24.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 Processor -- start 2024-09-15T22:58:24.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 -- start start 2024-09-15T22:58:24.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8458145970 0x7f84580b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:24.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84580d0960 con 0x7f84580d0360 2024-09-15T22:58:25.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84580d0c40 con 0x7f84580b2300 2024-09-15T22:58:25.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f845d448640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f84580b2770 con 0x7f8458145970 2024-09-15T22:58:25.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f84577fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f84580d0360 0x7f84580cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45746/0 (socket says 172.21.15.28:45746) 2024-09-15T22:58:25.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f84577fe640 1 -- 172.21.15.28:0/1555512035 learned_addr learned my addr 172.21.15.28:0/1555512035 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:25.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870325276 0 0) 0x7f84580d0960 con 0x7f84580d0360 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8456ffd640 1 --2- 172.21.15.28:0/1555512035 >> v2:172.21.15.131:3300/0 conn(0x7f8458145970 0x7f84580b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8444003530 con 0x7f84580d0360 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4222828583 0 0) 0x7f8444003530 con 0x7f84580d0360 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 >> v2:172.21.15.131:3300/0 conn(0x7f8458145970 msgr2=0x7f84580b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 --2- 172.21.15.28:0/1555512035 >> v2:172.21.15.131:3300/0 conn(0x7f8458145970 0x7f84580b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 >> v1:172.21.15.131:6789/0 conn(0x7f84580b2300 legacy=0x7f84580cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84580cd2b0 con 0x7f84580d0360 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f8450001a00 con 0x7f84580d0360 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 >> v1:172.21.15.28:6789/0 conn(0x7f84580d0360 legacy=0x7f84580cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84440039c0 0x7f8444003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 0x7f8444004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84440052f0 0x7f844400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84580b2770 con 0x7f8444004810 2024-09-15T22:58:25.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f844400c1c0 con 0x7f84440039c0 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f844400c3c0 con 0x7f84440052f0 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.991+0000 7f84567fc640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 0x7f8444004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f8456ffd640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84440039c0 0x7f8444003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84577fe640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84440052f0 0x7f844400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 -- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84440052f0 msgr2=0x7f844400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84440052f0 0x7f844400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 -- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84440039c0 msgr2=0x7f8444003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84440039c0 0x7f8444003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 -- 172.21.15.28:0/1555512035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8444003530 con 0x7f8444004810 2024-09-15T22:58:25.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84577fe640 1 -- 172.21.15.28:0/1555512035 reap_dead start 2024-09-15T22:58:25.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f84567fc640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 0x7f8444004c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8440001750 tx=0x7f844001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbb98a7a35a9443 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400013a0 con 0x7f8444004810 2024-09-15T22:58:25.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84400052f0 con 0x7f8444004810 2024-09-15T22:58:25.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f8455ffb640 1 -- 172.21.15.28:0/1555512035 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440003840 con 0x7f8444004810 2024-09-15T22:58:25.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 -- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 msgr2=0x7f8444004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 0x7f8444004c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8440001750 tx=0x7f844001c3a0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 -- 172.21.15.28:0/1555512035 shutdown_connections 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 --2- 172.21.15.28:0/1555512035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8444004810 0x7f8444004c90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 -- 172.21.15.28:0/1555512035 >> 172.21.15.28:0/1555512035 conn(0x7f845806bcc0 msgr2=0x7f845806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 -- 172.21.15.28:0/1555512035 shutdown_connections 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.995+0000 7f845d448640 1 -- 172.21.15.28:0/1555512035 wait complete. 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 Processor -- start 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- start start 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8444004810 0x7f84580c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84580acc90 0x7f84581f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84580cffe0 con 0x7f84580ae230 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84580cfe60 con 0x7f84580acc90 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f84580d0160 con 0x7f8444004810 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47452/0 (socket says 172.21.15.28:47452) 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 -- 172.21.15.28:0/2400050995 learned_addr learned my addr 172.21.15.28:0/2400050995 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84567fc640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84580acc90 0x7f84581f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f8456ffd640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8444004810 0x7f84580c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 -- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8444004810 msgr2=0x7f84580c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8444004810 0x7f84580c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 -- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84580acc90 msgr2=0x7f84581f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84580acc90 0x7f84581f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 -- 172.21.15.28:0/2400050995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84580c55e0 con 0x7f84580ae230 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f84577fe640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f84580b5670 tx=0x7f845000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845000ebb0 con 0x7f84580ae230 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845000ed70 con 0x7f84580ae230 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84580af820 con 0x7f84580ae230 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450014670 con 0x7f84580ae230 2024-09-15T22:58:25.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84580ad470 con 0x7f84580ae230 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8458072960 con 0x7f84580ae230 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:24.999+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8450014810 con 0x7f84580ae230 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.003+0000 7f844f7fe640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 0x7f8438069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.003+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f84500856f0 con 0x7f84580ae230 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.003+0000 7f8456ffd640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 0x7f8438069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.003+0000 7f8456ffd640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 0x7f8438069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f844800ba30 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.007+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8450056530 con 0x7f84580ae230 2024-09-15T22:58:25.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.171+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f845815c510 con 0x7f84380678c0 2024-09-15T22:58:25.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.171+0000 7f844f7fe640 1 -- 172.21.15.28:0/2400050995 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f844800b240 con 0x7f84380678c0 2024-09-15T22:58:25.176 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T22:58:25.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.171+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 msgr2=0x7f8438069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.171+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 0x7f8438069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f844800ba30 tx=0x7f8448008040 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 msgr2=0x7f84580ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f84580b5670 tx=0x7f845000e530 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 shutdown_connections 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84580ae230 0x7f84580ae6e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f84380678c0 0x7f8438069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84580acc90 0x7f84581f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 --2- 172.21.15.28:0/2400050995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8444004810 0x7f84580c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 >> 172.21.15.28:0/2400050995 conn(0x7f845806bcc0 msgr2=0x7f84580cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 shutdown_connections 2024-09-15T22:58:25.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.175+0000 7f845d448640 1 -- 172.21.15.28:0/2400050995 wait complete. 2024-09-15T22:58:25.195 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T22:58:25.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:58:25.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 Processor -- start 2024-09-15T22:58:25.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 -- start start 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7c0c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c0c0d1520 0x7f7c0c0d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c148470 con 0x7f7c0c14be60 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c148750 con 0x7f7c0c0d1520 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c110ee640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c148a30 con 0x7f7c0c147d80 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0a59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7c0c14be60 0x7f7c0c06cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45762/0 (socket says 172.21.15.28:45762) 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0a59c640 1 -- 172.21.15.28:0/1318139319 learned_addr learned my addr 172.21.15.28:0/1318139319 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0b59e640 1 --2- 172.21.15.28:0/1318139319 >> v2:172.21.15.131:3300/0 conn(0x7f7c0c0d1520 0x7f7c0c0d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7c0c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202376008 0 0) 0x7f7c0c148470 con 0x7f7c0c14be60 2024-09-15T22:58:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bf8003530 con 0x7f7c0c14be60 2024-09-15T22:58:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4155195627 0 0) 0x7f7bf8003530 con 0x7f7c0c14be60 2024-09-15T22:58:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 msgr2=0x7f7c0c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7c0c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 >> v2:172.21.15.131:3300/0 conn(0x7f7c0c0d1520 msgr2=0x7f7c0c0d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 --2- 172.21.15.28:0/1318139319 >> v2:172.21.15.131:3300/0 conn(0x7f7c0c0d1520 0x7f7c0c0d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c148d10 con 0x7f7c0c14be60 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f7bf4001680 con 0x7f7c0c14be60 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 >> v1:172.21.15.28:6789/0 conn(0x7f7c0c14be60 legacy=0x7f7c0c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7bf80039c0 0x7f7bf8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7bf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c148750 con 0x7f7bf80039c0 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c148a30 con 0x7f7bf8004d50 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf800b9d0 con 0x7f7c0c147d80 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7bf80039c0 0x7f7bf8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0a59c640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7bf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 -- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 msgr2=0x7f7bf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7bf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 -- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8004d50 msgr2=0x7f7bf80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0b59e640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0ad9d640 1 -- 172.21.15.28:0/1318139319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf8003530 con 0x7f7bf80039c0 2024-09-15T22:58:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.311+0000 7f7c0a59c640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c147d80 0x7f7bf8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7bf80039c0 0x7f7bf8003de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fc0 tx=0x7f7bfc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81573bcd06d38079 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0b2070 con 0x7f7bf80039c0 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0a5b80 con 0x7f7bf80039c0 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c09d9b640 1 -- 172.21.15.28:0/1318139319 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc009c10 con 0x7f7bf80039c0 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- 172.21.15.28:0/1318139319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7bf80039c0 msgr2=0x7f7bf8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 --2- 172.21.15.28:0/1318139319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7bf80039c0 0x7f7bf8003de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fc0 tx=0x7f7bfc01cc80 comp rx=0 tx=0).stop 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c0b59e640 1 -- 172.21.15.28:0/1318139319 reap_dead start 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- 172.21.15.28:0/1318139319 shutdown_connections 2024-09-15T22:58:25.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- 172.21.15.28:0/1318139319 >> 172.21.15.28:0/1318139319 conn(0x7f7c0c067e00 msgr2=0x7f7c0c068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- 172.21.15.28:0/1318139319 shutdown_connections 2024-09-15T22:58:25.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- 172.21.15.28:0/1318139319 wait complete. 2024-09-15T22:58:25.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 Processor -- start 2024-09-15T22:58:25.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- start start 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80039c0 0x7f7c0c0b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c15c390 0x7f7c0c165f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 0x7f7c0c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c167330 con 0x7f7c0c15f480 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c1671b0 con 0x7f7bf80039c0 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c110ee640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c1674b0 con 0x7f7c0c15c390 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c0b59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 0x7f7c0c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.315+0000 7f7c0b59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 0x7f7c0c15f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47480/0 (socket says 172.21.15.28:47480) 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 -- 172.21.15.28:0/2834090097 learned_addr learned my addr 172.21.15.28:0/2834090097 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80039c0 0x7f7c0c0b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 -- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c15c390 msgr2=0x7f7c0c165f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c0c15c390 0x7f7c0c165f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 -- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80039c0 msgr2=0x7f7c0c0b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80039c0 0x7f7c0c0b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c1474b0 con 0x7f7c0c15f480 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0b59e640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 0x7f7c0c15f900 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06ca30 tx=0x7f7c04010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400f040 con 0x7f7c0c15f480 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0401c070 con 0x7f7c0c15f480 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400eaa0 con 0x7f7c0c15f480 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c0b8d70 con 0x7f7c0c15f480 2024-09-15T22:58:25.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c0b84d0 con 0x7f7c0c15f480 2024-09-15T22:58:25.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c0c148470 con 0x7f7c0c15f480 2024-09-15T22:58:25.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c0400ec40 con 0x7f7c0c15f480 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7bec0678c0 0x7f7bec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f7c04085e40 con 0x7f7c0c15f480 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7bec0678c0 0x7f7bec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f7bec06d780 0x7f7bec06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c0401ce70 con 0x7f7bec06d780 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7c040862d0 con 0x7f7c0c15f480 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0a59c640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f7bec06d780 0x7f7bec06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0ad9d640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7bec0678c0 0x7f7bec069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0af000 tx=0x7f7bfc0a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.319+0000 7f7c0a59c640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f7bec06d780 0x7f7bec06fba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.323+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== osd.7 v2:172.21.15.131:6824/1980628062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c0401ce70 con 0x7f7bec06d780 2024-09-15T22:58:25.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 --> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7c0c06ca60 con 0x7f7bec06d780 2024-09-15T22:58:25.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c037fe640 1 -- 172.21.15.28:0/2834090097 <== osd.7 v2:172.21.15.131:6824/1980628062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7c0c06ca60 con 0x7f7bec06d780 2024-09-15T22:58:25.341 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-15T22:58:25.341 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:58:25.341 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-15T22:58:25.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f7bec06d780 msgr2=0x7f7bec06fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.131:6824/1980628062,v1:172.21.15.131:6825/1980628062] conn(0x7f7bec06d780 0x7f7bec06fba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7bec0678c0 msgr2=0x7f7bec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f7bec0678c0 0x7f7bec069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0af000 tx=0x7f7bfc0a7040 comp rx=0 tx=0).stop 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 msgr2=0x7f7c0c15f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 --2- 172.21.15.28:0/2834090097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c0c15f480 0x7f7c0c15f900 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c06ca30 tx=0x7f7c04010c20 comp rx=0 tx=0).stop 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c0b59e640 1 -- 172.21.15.28:0/2834090097 reap_dead start 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 shutdown_connections 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 >> 172.21.15.28:0/2834090097 conn(0x7f7c0c067e00 msgr2=0x7f7c0c146da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 shutdown_connections 2024-09-15T22:58:25.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.335+0000 7f7c110ee640 1 -- 172.21.15.28:0/2834090097 wait complete. 2024-09-15T22:58:25.356 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T22:58:25.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 Processor -- start 2024-09-15T22:58:25.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 -- start start 2024-09-15T22:58:25.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9e8145970 0x7fc9e80b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e80d0960 con 0x7fc9e80d0190 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e80d0f20 con 0x7fc9e8145970 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9f05a1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e80cd620 con 0x7fc9e80b2300 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9e8145970 0x7fc9e80b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9e8145970 0x7fc9e80b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47484/0 (socket says 172.21.15.28:47484) 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 -- 172.21.15.28:0/2259315111 learned_addr learned my addr 172.21.15.28:0/2259315111 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9edb3c640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 -- 172.21.15.28:0/2259315111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 msgr2=0x7fc9e80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 -- 172.21.15.28:0/2259315111 >> v1:172.21.15.131:6789/0 conn(0x7fc9e80d0190 legacy=0x7fc9e8072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.463+0000 7fc9ee33d640 1 -- 172.21.15.28:0/2259315111 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e80d0c40 con 0x7fc9e8145970 2024-09-15T22:58:25.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9ee33d640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e80b1dc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009870 tx=0x7fc9d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e3dc6443a7973b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9ed33b640 1 -- 172.21.15.28:0/2259315111 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80b0070 con 0x7fc9e8145970 2024-09-15T22:58:25.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9ed33b640 1 -- 172.21.15.28:0/2259315111 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d80ab600 con 0x7fc9e8145970 2024-09-15T22:58:25.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9ed33b640 1 -- 172.21.15.28:0/2259315111 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80ab9d0 con 0x7fc9e8145970 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2259315111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 msgr2=0x7fc9e80b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e80b1dc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009870 tx=0x7fc9d801c490 comp rx=0 tx=0).stop 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2259315111 shutdown_connections 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2259315111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e80b1dc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2259315111 >> 172.21.15.28:0/2259315111 conn(0x7fc9e806bcc0 msgr2=0x7fc9e806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2259315111 shutdown_connections 2024-09-15T22:58:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2259315111 wait complete. 2024-09-15T22:58:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.467+0000 7fc9f05a1640 1 Processor -- start 2024-09-15T22:58:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- start start 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 0x7fc9e8141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8168fe0 con 0x7fc9e8145970 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8168e60 con 0x7fc9e80d0190 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e8169160 con 0x7fc9e80b2300 2024-09-15T22:58:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47488/0 (socket says 172.21.15.28:47488) 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 -- 172.21.15.28:0/2288152385 learned_addr learned my addr 172.21.15.28:0/2288152385 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9ee33d640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9edb3c640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 0x7fc9e8141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 -- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 msgr2=0x7fc9e80c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 -- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 msgr2=0x7fc9e8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 0x7fc9e8141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 -- 172.21.15.28:0/2288152385 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e80acba0 con 0x7fc9e8145970 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9edb3c640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 0x7fc9e8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9eeb3e640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b970 tx=0x7fc9e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0019070 con 0x7fc9e8145970 2024-09-15T22:58:25.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e000cb40 con 0x7fc9e8145970 2024-09-15T22:58:25.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e80ace80 con 0x7fc9e8145970 2024-09-15T22:58:25.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0014440 con 0x7fc9e8145970 2024-09-15T22:58:25.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e80ad440 con 0x7fc9e8145970 2024-09-15T22:58:25.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e80cfc50 con 0x7fc9e8145970 2024-09-15T22:58:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9e001c070 con 0x7fc9e8145970 2024-09-15T22:58:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 0x7fc9cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fc9e0085570 con 0x7fc9e8145970 2024-09-15T22:58:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.471+0000 7fc9ee33d640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 0x7fc9cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.475+0000 7fc9ee33d640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 0x7fc9cc069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80ad000 tx=0x7fc9d80a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.475+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc9e0056440 con 0x7fc9e8145970 2024-09-15T22:58:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.639+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc9e80c5ff0 con 0x7fc9cc0678c0 2024-09-15T22:58:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.639+0000 7fc9deffd640 1 -- 172.21.15.28:0/2288152385 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9e80c5ff0 con 0x7fc9cc0678c0 2024-09-15T22:58:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T22:58:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 msgr2=0x7fc9cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 0x7fc9cc069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80ad000 tx=0x7fc9d80a6000 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 msgr2=0x7fc9e8143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b970 tx=0x7fc9e000be30 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 shutdown_connections 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9e8145970 0x7fc9e8143a10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7fc9cc0678c0 0x7fc9cc069d80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9e80d0190 0x7fc9e8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 --2- 172.21.15.28:0/2288152385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9e80b2300 0x7fc9e80c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 >> 172.21.15.28:0/2288152385 conn(0x7fc9e806bcc0 msgr2=0x7fc9e8073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 shutdown_connections 2024-09-15T22:58:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.643+0000 7fc9f05a1640 1 -- 172.21.15.28:0/2288152385 wait complete. 2024-09-15T22:58:25.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:58:25.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 Processor -- start 2024-09-15T22:58:25.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 -- start start 2024-09-15T22:58:25.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57b8158a50 0x7f57b815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b815eb40 con 0x7f57b80b46d0 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b8158e30 con 0x7f57b80b67c0 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57bd029640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f57b80b72f0 con 0x7f57b8158a50 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57b8158a50 0x7f57b815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b759e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f57b80b46d0 0x7f57b806cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45766/0 (socket says 172.21.15.28:45766) 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57b8158a50 0x7f57b815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47504/0 (socket says 172.21.15.28:47504) 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 -- 172.21.15.28:0/3461194207 learned_addr learned my addr 172.21.15.28:0/3461194207 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 -- 172.21.15.28:0/3461194207 >> v1:172.21.15.131:6789/0 conn(0x7f57b80b67c0 legacy=0x7f57b80b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:25.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 -- 172.21.15.28:0/3461194207 >> v1:172.21.15.28:6789/0 conn(0x7f57b80b46d0 legacy=0x7f57b806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.783+0000 7f57b6d9d640 1 -- 172.21.15.28:0/3461194207 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b815ede0 con 0x7f57b8158a50 2024-09-15T22:58:25.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b6d9d640 1 --2- 172.21.15.28:0/3461194207 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b815f5e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009e50 tx=0x7f57b806dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d444eb7acaa1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b5d9b640 1 -- 172.21.15.28:0/3461194207 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80a57d0 con 0x7f57b8158a50 2024-09-15T22:58:25.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b5d9b640 1 -- 172.21.15.28:0/3461194207 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a80a5970 con 0x7f57b8158a50 2024-09-15T22:58:25.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b5d9b640 1 -- 172.21.15.28:0/3461194207 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80a5d40 con 0x7f57b8158a50 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- 172.21.15.28:0/3461194207 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 msgr2=0x7f57b815f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 --2- 172.21.15.28:0/3461194207 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b815f5e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009e50 tx=0x7f57b806dcf0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- 172.21.15.28:0/3461194207 shutdown_connections 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 --2- 172.21.15.28:0/3461194207 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b815f5e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- 172.21.15.28:0/3461194207 >> 172.21.15.28:0/3461194207 conn(0x7f57b806bec0 msgr2=0x7f57b806c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- 172.21.15.28:0/3461194207 shutdown_connections 2024-09-15T22:58:25.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- 172.21.15.28:0/3461194207 wait complete. 2024-09-15T22:58:25.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 Processor -- start 2024-09-15T22:58:25.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- start start 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b80b46d0 0x7f57b8153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b80b67c0 0x7f57b80d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57b816c300 con 0x7f57b8158a50 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f57b816c180 con 0x7f57b80b46d0 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57bd029640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f57b816c480 con 0x7f57b80b67c0 2024-09-15T22:58:25.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47510/0 (socket says 172.21.15.28:47510) 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 -- 172.21.15.28:0/1488209527 learned_addr learned my addr 172.21.15.28:0/1488209527 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b6d9d640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b80b46d0 0x7f57b8153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b659c640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b80b67c0 0x7f57b80d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 -- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b80b67c0 msgr2=0x7f57b80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b80b67c0 0x7f57b80d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 -- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b80b46d0 msgr2=0x7f57b8153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b80b46d0 0x7f57b8153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 -- 172.21.15.28:0/1488209527 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80d1a10 con 0x7f57b8158a50 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f57b759e640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c3c0 tx=0x7f57b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b00074e0 con 0x7f57b8158a50 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b0007680 con 0x7f57b8158a50 2024-09-15T22:58:25.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.787+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0004a30 con 0x7f57b8158a50 2024-09-15T22:58:25.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b80d1cf0 con 0x7f57b8158a50 2024-09-15T22:58:25.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b80d2590 con 0x7f57b8158a50 2024-09-15T22:58:25.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b80d2760 con 0x7f57b8158a50 2024-09-15T22:58:25.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57b001a020 con 0x7f57b8158a50 2024-09-15T22:58:25.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f579f7fe640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 0x7f57a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:25.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f57b6d9d640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 0x7f57a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:25.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f57b0084fd0 con 0x7f57b8158a50 2024-09-15T22:58:25.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.791+0000 7f57b6d9d640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 0x7f57a4069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ae000 tx=0x7f57a8004ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:25.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.795+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57b0055ea0 con 0x7f57b8158a50 2024-09-15T22:58:25.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57b815e140 con 0x7f57a40678c0 2024-09-15T22:58:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f579f7fe640 1 -- 172.21.15.28:0/1488209527 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13355 (secure 0 0 0) 0x7f57b815e140 con 0x7f57a40678c0 2024-09-15T22:58:25.956 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 msgr2=0x7f57a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 0x7f57a4069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ae000 tx=0x7f57a8004ac0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 msgr2=0x7f57b8152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c3c0 tx=0x7f57b000c880 comp rx=0 tx=0).stop 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 shutdown_connections 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57b8158a50 0x7f57b8152540 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b80b67c0 0x7f57b80d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f57a40678c0 0x7f57a4069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 --2- 172.21.15.28:0/1488209527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b80b46d0 0x7f57b8153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.951+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 >> 172.21.15.28:0/1488209527 conn(0x7f57b806bec0 msgr2=0x7f57b806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.955+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 shutdown_connections 2024-09-15T22:58:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:25.955+0000 7f57bd029640 1 -- 172.21.15.28:0/1488209527 wait complete. 2024-09-15T22:58:25.974 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-15T22:58:25.905052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238824,"kb_used_data":5960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735896,"statfs":{"total":773094113280,"available":772849557504,"internally_reserved":0,"allocated":6103040,"data_stored":3212200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.258612"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T22:58:18.627786+0000","last_change":"2024-09-15T22:56:12.397314+0000","last_active":"2024-09-15T22:58:18.627786+0000","last_peered":"2024-09-15T22:58:18.627786+0000","last_clean":"2024-09-15T22:58:18.627786+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:58:18.627786+0000","last_undegraded":"2024-09-15T22:58:18.627786+0000","last_fullsized":"2024-09-15T22:58:18.627786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:56:10.633714+0000","last_clean_scrub_stamp":"2024-09-15T22:56:10.633714+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:07.624927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1208320,"data_stored":844301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1208320,"data_stored":844301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:58:25.977 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T22:56:10.633714+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=56, tm_sec=10, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=58, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:58:25.977 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T22:58:45.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:45.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:45.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:58:46.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 Processor -- start 2024-09-15T22:58:46.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 -- start start 2024-09-15T22:58:46.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f22080b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22080cfa80 0x7f22080b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f22080b5150 0x7f22080aef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f22080b4780 con 0x7f22080cfa80 2024-09-15T22:58:46.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f22080b4450 con 0x7f22080b5150 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f220df64640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22080b3960 con 0x7f220815e370 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22080cfa80 0x7f22080b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22080cfa80 0x7f22080b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40380/0 (socket says 172.21.15.28:40380) 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 -- 172.21.15.28:0/3134788011 learned_addr learned my addr 172.21.15.28:0/3134788011 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f2207fff640 1 --2- 172.21.15.28:0/3134788011 >> v2:172.21.15.131:3300/0 conn(0x7f22080b5150 0x7f22080aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f22077fe640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f22080b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 -- 172.21.15.28:0/3134788011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 msgr2=0x7f22080b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f22080b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 -- 172.21.15.28:0/3134788011 >> v2:172.21.15.131:3300/0 conn(0x7f22080b5150 msgr2=0x7f22080aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 --2- 172.21.15.28:0/3134788011 >> v2:172.21.15.131:3300/0 conn(0x7f22080b5150 0x7f22080aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.111+0000 7f21feffd640 1 -- 172.21.15.28:0/3134788011 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22080b3c40 con 0x7f22080cfa80 2024-09-15T22:58:46.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f21feffd640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080cfa80 0x7f22080b4c10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2208070d50 tx=0x7f21f001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5629e3f258173d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f2206ffd640 1 -- 172.21.15.28:0/3134788011 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00b0070 con 0x7f22080cfa80 2024-09-15T22:58:46.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f2206ffd640 1 -- 172.21.15.28:0/3134788011 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f00ab600 con 0x7f22080cfa80 2024-09-15T22:58:46.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f2206ffd640 1 -- 172.21.15.28:0/3134788011 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00ab9d0 con 0x7f22080cfa80 2024-09-15T22:58:46.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- 172.21.15.28:0/3134788011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080cfa80 msgr2=0x7f22080b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080cfa80 0x7f22080b4c10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2208070d50 tx=0x7f21f001c520 comp rx=0 tx=0).stop 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- 172.21.15.28:0/3134788011 shutdown_connections 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 --2- 172.21.15.28:0/3134788011 >> v2:172.21.15.131:3300/0 conn(0x7f22080b5150 0x7f22080aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080cfa80 0x7f22080b4c10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 --2- 172.21.15.28:0/3134788011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f22080b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- 172.21.15.28:0/3134788011 >> 172.21.15.28:0/3134788011 conn(0x7f220806bcc0 msgr2=0x7f220806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- 172.21.15.28:0/3134788011 shutdown_connections 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- 172.21.15.28:0/3134788011 wait complete. 2024-09-15T22:58:46.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 Processor -- start 2024-09-15T22:58:46.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.115+0000 7f220df64640 1 -- start start 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 0x7f2208159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f220815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22080d0050 con 0x7f22080b5150 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22080af870 con 0x7f22080cfa80 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22080d01d0 con 0x7f220815e370 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40386/0 (socket says 172.21.15.28:40386) 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 -- 172.21.15.28:0/74125592 learned_addr learned my addr 172.21.15.28:0/74125592 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f21feffd640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 0x7f2208159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2207fff640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f220815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 -- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 msgr2=0x7f220815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f220815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 -- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 msgr2=0x7f2208159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 0x7f2208159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 -- 172.21.15.28:0/74125592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2208071030 con 0x7f22080b5150 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2207fff640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f220815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f21feffd640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 0x7f2208159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f22077fe640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d5f0 tx=0x7f21f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80125f0 con 0x7f22080b5150 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f8019070 con 0x7f22080b5150 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2208071310 con 0x7f22080b5150 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80129d0 con 0x7f22080b5150 2024-09-15T22:58:46.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22080718d0 con 0x7f22080b5150 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22080b4c10 con 0x7f22080b5150 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21f8012b70 con 0x7f22080b5150 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 0x7f21e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f21f8085d10 con 0x7f22080b5150 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.119+0000 7f21feffd640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 0x7f21e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.123+0000 7f21feffd640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 0x7f21e8069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ad000 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.127+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21f8056be0 con 0x7f22080b5150 2024-09-15T22:58:46.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.287+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 --> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22080740d0 con 0x7f21e80678c0 2024-09-15T22:58:46.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.287+0000 7f2204ff9640 1 -- 172.21.15.28:0/74125592 <== mgr.4108 v2:172.21.15.28:6832/3892311058 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f22080740d0 con 0x7f21e80678c0 2024-09-15T22:58:46.294 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:46.294 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-15T22:58:46.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 msgr2=0x7f21e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 0x7f21e8069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ad000 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 msgr2=0x7f220814b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d5f0 tx=0x7f21f800dab0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 shutdown_connections 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f220815e370 0x7f220815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f21e80678c0 0x7f21e8069d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22080cfa80 0x7f2208159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 --2- 172.21.15.28:0/74125592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22080b5150 0x7f220814b720 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 >> 172.21.15.28:0/74125592 conn(0x7f220806bcc0 msgr2=0x7f220806da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 shutdown_connections 2024-09-15T22:58:46.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.291+0000 7f220df64640 1 -- 172.21.15.28:0/74125592 wait complete. 2024-09-15T22:58:46.313 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-15T22:58:45.910208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238816,"kb_used_data":5960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735904,"statfs":{"total":773094113280,"available":772849565696,"internally_reserved":0,"allocated":6103040,"data_stored":3212200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003065"},"pg_stats":[{"pgid":"1.0","version":"51'119","reported_seq":238,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T22:58:26.471175+0000","last_change":"2024-09-15T22:58:26.471250+0000","last_active":"2024-09-15T22:58:26.471175+0000","last_peered":"2024-09-15T22:58:26.471175+0000","last_clean":"2024-09-15T22:58:26.471175+0000","last_became_active":"2024-09-15T22:56:12.392863+0000","last_became_peered":"2024-09-15T22:56:12.392863+0000","last_unstale":"2024-09-15T22:58:26.471175+0000","last_undegraded":"2024-09-15T22:58:26.471175+0000","last_fullsized":"2024-09-15T22:58:26.471175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2024-09-15T22:58:26.470977+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2024-09-15T22:58:26.470977+0000","last_clean_scrub_stamp":"2024-09-15T22:58:26.470977+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:39.981281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1208320,"data_stored":844301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":253933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":844301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:58:46.314 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T22:58:46.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 Processor -- start 2024-09-15T22:58:46.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 -- start start 2024-09-15T22:58:46.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015aa60 0x7f74f00b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74f015ae40 0x7f74f00cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f00d0340 con 0x7f74f00b4780 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f74f00d0620 con 0x7f74f015ae40 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f760d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00d0900 con 0x7f74f015aa60 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74f015ae40 0x7f74f00cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74f015ae40 0x7f74f00cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40398/0 (socket says 172.21.15.28:40398) 2024-09-15T22:58:46.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 -- 172.21.15.28:0/300246426 learned_addr learned my addr 172.21.15.28:0/300246426 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:46.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f53a9640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015aa60 0x7f74f00b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 -- 172.21.15.28:0/300246426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015aa60 msgr2=0x7f74f00b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015aa60 0x7f74f00b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 -- 172.21.15.28:0/300246426 >> v1:172.21.15.131:6789/0 conn(0x7f74f00b4780 legacy=0x7f74f00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.439+0000 7f74f4ba8640 1 -- 172.21.15.28:0/300246426 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f00cd2c0 con 0x7f74f015ae40 2024-09-15T22:58:46.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f4ba8640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015ae40 0x7f74f00cfaf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009e50 tx=0x7f74ec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e94835d56293fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74e3fff640 1 -- 172.21.15.28:0/300246426 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0a5680 con 0x7f74f015ae40 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74e3fff640 1 -- 172.21.15.28:0/300246426 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec0a5820 con 0x7f74f015ae40 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74e3fff640 1 -- 172.21.15.28:0/300246426 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0a5bf0 con 0x7f74f015ae40 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- 172.21.15.28:0/300246426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015ae40 msgr2=0x7f74f00cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015ae40 0x7f74f00cfaf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009e50 tx=0x7f74ec01ca30 comp rx=0 tx=0).stop 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- 172.21.15.28:0/300246426 shutdown_connections 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015ae40 0x7f74f00cfaf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 --2- 172.21.15.28:0/300246426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015aa60 0x7f74f00b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- 172.21.15.28:0/300246426 >> 172.21.15.28:0/300246426 conn(0x7f74f006bcc0 msgr2=0x7f74f006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- 172.21.15.28:0/300246426 shutdown_connections 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- 172.21.15.28:0/300246426 wait complete. 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 Processor -- start 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.443+0000 7f74f760d640 1 -- start start 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 0x7f74f014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015ae40 0x7f74f01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00ce070 con 0x7f74f015aa60 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00cdef0 con 0x7f74f00b4780 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00ce1f0 con 0x7f74f015ae40 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40404/0 (socket says 172.21.15.28:40404) 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 -- 172.21.15.28:0/2028140602 learned_addr learned my addr 172.21.15.28:0/2028140602 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f53a9640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 0x7f74f014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f5baa640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015ae40 0x7f74f01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 -- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015ae40 msgr2=0x7f74f01506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015ae40 0x7f74f01506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 -- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 msgr2=0x7f74f014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 0x7f74f014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 -- 172.21.15.28:0/2028140602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f014f6a0 con 0x7f74f015aa60 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f53a9640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 0x7f74f014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f4ba8640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0af040 tx=0x7f74ec0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0b8440 con 0x7f74f015aa60 2024-09-15T22:58:46.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec0b85e0 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f014f910 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0b89b0 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f014fed0 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f0069220 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74ec0c1020 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 0x7f74d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f74ec11fe80 con 0x7f74f015aa60 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f53a9640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 0x7f74d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.447+0000 7f74f53a9640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 0x7f74d4069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74f01f8b20 tx=0x7f74e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.451+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74ec0c8020 con 0x7f74f015aa60 2024-09-15T22:58:46.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.615+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f74f00ce600 con 0x7f74f015aa60 2024-09-15T22:58:46.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.615+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f74ec016620 con 0x7f74f015aa60 2024-09-15T22:58:46.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74e1ffb640 1 -- 172.21.15.28:0/2028140602 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f74ec0a5820 con 0x7f74f015aa60 2024-09-15T22:58:46.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 msgr2=0x7f74d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 0x7f74d4069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74f01f8b20 tx=0x7f74e4008040 comp rx=0 tx=0).stop 2024-09-15T22:58:46.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 msgr2=0x7f74f0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0af040 tx=0x7f74ec0197d0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 shutdown_connections 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74f015ae40 0x7f74f01506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74f015aa60 0x7f74f0072cf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f74d40678c0 0x7f74d4069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 --2- 172.21.15.28:0/2028140602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74f00b4780 0x7f74f014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 >> 172.21.15.28:0/2028140602 conn(0x7f74f006bcc0 msgr2=0x7f74f015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 shutdown_connections 2024-09-15T22:58:46.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.619+0000 7f74f760d640 1 -- 172.21.15.28:0/2028140602 wait complete. 2024-09-15T22:58:46.641 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:58:46.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:58:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 Processor -- start 2024-09-15T22:58:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 -- start start 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38c40af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c40b4450 con 0x7f38c40cfa80 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c40b3960 con 0x7f38c415e370 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38caf65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38c40b4780 con 0x7f38c40aef20 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f38c40cfa80 0x7f38c40b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45530/0 (socket says 172.21.15.28:45530) 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 -- 172.21.15.28:0/2788655563 learned_addr learned my addr 172.21.15.28:0/2788655563 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c9502640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38c40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078753459 0 0) 0x7f38c40b4450 con 0x7f38c40cfa80 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ac003530 con 0x7f38c40cfa80 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3677567590 0 0) 0x7f38ac003530 con 0x7f38c40cfa80 2024-09-15T22:58:46.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 msgr2=0x7f38c40af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38c40af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 >> v1:172.21.15.131:6789/0 conn(0x7f38c415e370 legacy=0x7f38c40b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c40b3c40 con 0x7f38c40cfa80 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2066357507 0 0) 0x7f38b80016a0 con 0x7f38c40cfa80 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 >> v1:172.21.15.28:6789/0 conn(0x7f38c40cfa80 legacy=0x7f38c40b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0039f0 0x7f38ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38ac004810 0x7f38ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40b4780 con 0x7f38ac004810 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac00ba80 con 0x7f38ac0039f0 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38ac00bc80 con 0x7f38c40aef20 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38ac004810 0x7f38ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c9502640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c8d01640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0039f0 0x7f38ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 -- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 msgr2=0x7f38ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c40aef20 0x7f38ac0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 -- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0039f0 msgr2=0x7f38ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0039f0 0x7f38ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c3fff640 1 -- 172.21.15.28:0/2788655563 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac003530 con 0x7f38ac004810 2024-09-15T22:58:46.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.755+0000 7f38c8d01640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0039f0 0x7f38ac003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c3fff640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38ac004810 0x7f38ac004c90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f38c406f0b0 tx=0x7f38b801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d492b5ac86962a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8007d20 con 0x7f38ac004810 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f38b8005b00 con 0x7f38ac004810 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c37fe640 1 -- 172.21.15.28:0/2788655563 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8007070 con 0x7f38ac004810 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- 172.21.15.28:0/2788655563 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38ac004810 msgr2=0x7f38ac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 --2- 172.21.15.28:0/2788655563 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38ac004810 0x7f38ac004c90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f38c406f0b0 tx=0x7f38b801f370 comp rx=0 tx=0).stop 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 -- 172.21.15.28:0/2788655563 reap_dead start 2024-09-15T22:58:46.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- 172.21.15.28:0/2788655563 shutdown_connections 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- 172.21.15.28:0/2788655563 >> 172.21.15.28:0/2788655563 conn(0x7f38c406bcc0 msgr2=0x7f38c406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- 172.21.15.28:0/2788655563 shutdown_connections 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- 172.21.15.28:0/2788655563 wait complete. 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 Processor -- start 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- start start 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 0x7f38c4148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c4152750 0x7f38c415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38c415e8d0 con 0x7f38c4160040 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38c415e750 con 0x7f38ac004810 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38caf65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38c40b5320 con 0x7f38c4152750 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40414/0 (socket says 172.21.15.28:40414) 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 -- 172.21.15.28:0/122625856 learned_addr learned my addr 172.21.15.28:0/122625856 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 -- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c4152750 msgr2=0x7f38c415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c3fff640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c4152750 0x7f38c415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c4152750 0x7f38c415fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c8d01640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 0x7f38c4148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.759+0000 7f38c9502640 1 -- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 msgr2=0x7f38c4148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c9502640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 0x7f38c4148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c9502640 1 -- 172.21.15.28:0/122625856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c4155400 con 0x7f38c4160040 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c8d01640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 0x7f38c4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c9502640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38c406cc20 tx=0x7f38bc010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00f040 con 0x7f38c4160040 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f38bc01c070 con 0x7f38c4160040 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c40711d0 con 0x7f38c4160040 2024-09-15T22:58:46.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00eb20 con 0x7f38c4160040 2024-09-15T22:58:46.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c4071790 con 0x7f38c4160040 2024-09-15T22:58:46.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c40af370 con 0x7f38c4160040 2024-09-15T22:58:46.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38bc00ecc0 con 0x7f38c4160040 2024-09-15T22:58:46.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 0x7f38b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:46.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c8d01640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 0x7f38b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:46.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f38bc085640 con 0x7f38c4160040 2024-09-15T22:58:46.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.763+0000 7f38c8d01640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 0x7f38b0069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f38b4001e10 tx=0x7f38b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:46.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.767+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38bc026020 con 0x7f38c4160040 2024-09-15T22:58:46.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38c40af8a0 con 0x7f38c4160040 2024-09-15T22:58:46.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38c17fa640 1 -- 172.21.15.28:0/122625856 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3917 (secure 0 0 0) 0x7f38bc0563f0 con 0x7f38c4160040 2024-09-15T22:58:46.963 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-15T22:58:46.963 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"btime":"2024-09-15T22:58:15:633147+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/3566939843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3566939843},{"type":"v1","addr":"172.21.15.131:6833","nonce":3566939843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2192021279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2192021279},{"type":"v1","addr":"172.21.15.131:6835","nonce":2192021279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/3832516728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3832516728},{"type":"v1","addr":"172.21.15.28:6835","nonce":3832516728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3951184836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":3951184836},{"type":"v1","addr":"172.21.15.28:6837","nonce":3951184836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-15T22:58:46.963 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-09-15T22:58:46.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 msgr2=0x7f38b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 0x7f38b0069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f38b4001e10 tx=0x7f38b4009040 comp rx=0 tx=0).stop 2024-09-15T22:58:46.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 msgr2=0x7f38c41604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:46.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38c406cc20 tx=0x7f38bc010c20 comp rx=0 tx=0).stop 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 shutdown_connections 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38c4160040 0x7f38c41604c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38c4152750 0x7f38c415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.28:6832/3892311058,v1:172.21.15.28:6833/3892311058] conn(0x7f38b00678c0 0x7f38b0069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 --2- 172.21.15.28:0/122625856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac004810 0x7f38c4148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 >> 172.21.15.28:0/122625856 conn(0x7f38c406bcc0 msgr2=0x7f38c40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 shutdown_connections 2024-09-15T22:58:46.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-15T22:58:46.959+0000 7f38caf65640 1 -- 172.21.15.28:0/122625856 wait complete. 2024-09-15T22:58:46.981 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T22:58:46.982 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T22:58:46.982 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:58:46.982 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:46.993 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:58:46.993 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:58:46.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:47.044 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:58:47.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:58:47.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:47.060 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:58:47.060 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:58:47.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:47.118 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:58:47.118 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T22:58:47.118 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T22:58:47.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:47.186 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T22:58:47.186 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T22:58:47.186 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:47.277 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T22:58:47.277 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T22:58:47.277 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:51.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-15T22:58:53.379 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T22:58:53.379 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T22:58:53.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.444 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T22:58:53.445 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T22:58:53.445 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.517 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T22:58:53.518 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T22:58:53.518 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.606 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T22:58:53.607 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T22:58:53.607 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.669 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T22:58:53.669 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T22:58:53.669 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.738 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T22:58:53.738 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T22:58:53.739 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T22:58:53.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.769 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T22:58:53.769 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T22:58:53.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.803 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T22:58:53.803 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T22:58:53.804 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T22:58:53.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.830 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T22:58:53.830 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T22:58:53.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.860 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T22:58:53.860 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T22:58:53.860 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:58:53.916 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T22:58:53.917 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T22:58:53.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:58:53.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:53.937 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T22:58:54.398 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:54.399 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T22:58:54.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:54.629 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T22:58:54.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:54.820 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T22:58:55.029 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:55.029 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T22:58:55.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:55.316 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T22:58:55.509 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:55.509 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T22:58:55.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:55.649 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T22:58:55.808 INFO:tasks.ceph:Archiving mon data... 2024-09-15T22:58:56.061 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/data/mon.a.tgz 2024-09-15T22:58:56.062 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-15T22:58:56.070 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.nubD3qMgrc 2024-09-15T22:58:56.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nubD3qMgrc 2024-09-15T22:58:56.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.nubD3qMgrc 2024-09-15T22:58:56.272 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.nubD3qMgrc is 330KB 2024-09-15T22:58:56.461 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.nubD3qMgrc 2024-09-15T22:58:56.467 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/data/mon.b.tgz 2024-09-15T22:58:56.467 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-15T22:58:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.OLfj5qsQiA 2024-09-15T22:58:56.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OLfj5qsQiA 2024-09-15T22:58:56.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.OLfj5qsQiA 2024-09-15T22:58:56.680 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.OLfj5qsQiA is 436KB 2024-09-15T22:58:56.738 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.OLfj5qsQiA 2024-09-15T22:58:56.744 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/data/mon.c.tgz 2024-09-15T22:58:56.744 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-15T22:58:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.A0UCTSbueX 2024-09-15T22:58:56.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.A0UCTSbueX 2024-09-15T22:58:56.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-15T22:58:56.942 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.A0UCTSbueX 2024-09-15T22:58:57.005 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.A0UCTSbueX is 436KB 2024-09-15T22:58:57.066 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.A0UCTSbueX 2024-09-15T22:58:57.071 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T22:58:57.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:58:57.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:58:57.135 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:58:57.173 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:58:57.173 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T22:58:57.175 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi028/crash 2024-09-15T22:58:57.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:58:57.191 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi131/crash 2024-09-15T22:58:57.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:58:57.228 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T22:58:57.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:57.239 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:57.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:57.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:58:57.367 INFO:tasks.ceph:Compressing logs... 2024-09-15T22:58:57.368 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:58:57.375 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:58:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-09-15T22:58:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39067.log 2024-09-15T22:58:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-09-15T22:58:57.395 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-09-15T22:58:57.395 INFO:teuthology.orchestra.run.smithi028.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-09-15T22:58:57.395 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39067.log.gz 2024-09-15T22:58:57.396 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36510.log 2024-09-15T22:58:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37678.log: /var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34802.log 2024-09-15T22:58:57.397 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-09-15T22:58:57.397 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5%/var/log/ceph/ceph-client.admin.36510.log: -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-09-15T22:58:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-15T22:58:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36510.log.gz 2024-09-15T22:58:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2024-09-15T22:58:57.398 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34802.log.gz 2024-09-15T22:58:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35767.log 2024-09-15T22:58:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37705.log 2024-09-15T22:58:57.399 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-15T22:58:57.399 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.35767.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T22:58:57.399 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2024-09-15T22:58:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-09-15T22:58:57.400 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37705.log.gz 2024-09-15T22:58:57.400 INFO:teuthology.orchestra.run.smithi028.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.35767.log.gz 2024-09-15T22:58:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-09-15T22:58:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37514.log 2024-09-15T22:58:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37648.log: /var/log/ceph/ceph-client.admin.40557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39145.log 2024-09-15T22:58:57.401 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2024-09-15T22:58:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.37514.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-09-15T22:58:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2024-09-15T22:58:57.402 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34334.log 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39145.log.gz 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35962.log 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34334.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37514.log.gz 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34334.log.gz 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T22:58:57.403 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35962.log: /var/log/ceph/ceph-client.admin.38555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35962.log.gz 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.0.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34362.log 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37382.log/var/log/ceph/ceph-client.admin.36354.log: 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34362.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-15T22:58:57.404 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37090.log 2024-09-15T22:58:57.405 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34362.log.gz 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39699.log 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37090.log: /var/log/ceph/ceph-client.admin.35198.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37382.log.gz 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36406.log 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37090.log.gz 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-09-15T22:58:57.406 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36406.log: /var/log/ceph/ceph-client.admin.36894.log 2024-09-15T22:58:57.407 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39699.log.gz 2024-09-15T22:58:57.407 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36100.log: gzip 88.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.36406.log.gz /var/log/ceph/ceph-client.admin.37302.log 2024-09-15T22:58:57.408 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.408 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-09-15T22:58:57.408 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38222.log 2024-09-15T22:58:57.408 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2024-09-15T22:58:57.408 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38503.log 2024-09-15T22:58:57.409 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37302.log.gz 2024-09-15T22:58:57.409 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34789.log 2024-09-15T22:58:57.409 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2024-09-15T22:58:57.409 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38222.log.gz 2024-09-15T22:58:57.410 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-09-15T22:58:57.410 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38503.log.gz 2024-09-15T22:58:57.410 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34789.log.gz 2024-09-15T22:58:57.410 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.35454.log: /var/log/ceph/ceph-client.admin.36484.log 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40193.log 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-09-15T22:58:57.411 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-09-15T22:58:57.412 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40193.log.gz 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39448.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.39448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39504.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38076.log: /var/log/ceph/ceph-client.admin.39504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-15T22:58:57.414 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39504.log.gz 2024-09-15T22:58:57.415 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36562.log/var/log/ceph/ceph-client.admin.37146.log: 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.39448.log.gz 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40349.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40713.log 2024-09-15T22:58:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37172.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.40713.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36562.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40713.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35532.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39015.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38248.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40401.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35532.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5/var/log/ceph/ceph-client.admin.39015.log: --verbose -- /var/log/ceph/ceph.tmp-client.admin.23923.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40401.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.38326.log 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39015.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.23923.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23923.log.gz 2024-09-15T22:58:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38103.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40401.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38818.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38103.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38326.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38103.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38818.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38818.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39361.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39920.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3%/var/log/ceph/ceph-client.admin.39361.log: -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39731.log 2024-09-15T22:58:57.422 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39361.log.gz 2024-09-15T22:58:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-15T22:58:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-09-15T22:58:57.424 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39920.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36074.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39731.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39790.log 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2024-09-15T22:58:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35402.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39764.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39790.log.gz 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39764.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35402.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38846.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39764.log.gz 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38846.log: gzip/var/log/ceph/ceph-client.admin.38933.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36842.log 2024-09-15T22:58:57.428 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38846.log.gz 2024-09-15T22:58:57.429 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz -- 2024-09-15T22:58:57.429 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.34994.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2%/var/log/ceph/ceph-client.admin.34994.log: -- replaced with /var/log/ceph/ceph-client.admin.36842.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34994.log.gz 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38449.log: -- /var/log/ceph/ceph-client.admin.39307.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35216.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4%/var/log/ceph/ceph-client.admin.39307.log: -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34414.log 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-09-15T22:58:57.431 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35216.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35216.log.gz 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37038.log 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34414.log.gz 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35014.log 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-09-15T22:58:57.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37038.log.gz 2024-09-15T22:58:57.435 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2024-09-15T22:58:57.435 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35014.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37622.log 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38196.log 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9%/var/log/ceph/ceph-client.admin.37622.log: -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38274.log 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37622.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37568.log 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38196.log: /var/log/ceph/ceph-client.admin.38274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38196.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37568.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38274.log.gz 2024-09-15T22:58:57.436 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38607.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34988.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.3.34988.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.3.34988.log.gz 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29110.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.29182.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-15T22:58:57.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29134.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29038.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29110.log.gz 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.29134.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29134.log.gz 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29038.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29206.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29038.log.gz 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29062.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29206.log.gz/var/log/ceph/ceph-mon.c.log: 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29086.log 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.29062.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:58:57.452 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29062.log.gz 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.29086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29158.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29086.log.gz/var/log/ceph/ceph-mds.d.log: 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz -5 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.1.34867.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.29158.log: -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.1.34867.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29158.log.gz 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T22:58:57.453 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: 88.3% -- replaced with /var/log/ceph/ceph-client.1.34867.log.gz 2024-09-15T22:58:57.460 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T22:58:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40271.log: -- replaced with /var/log/ceph/ceph-client.admin.37568.log.gz 2024-09-15T22:58:57.460 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34306.log 88.7% 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38607.log.gz 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.40427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37224.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7%/var/log/ceph/ceph-client.admin.34306.log: -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39588.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34306.log.gz/var/log/ceph/ceph-client.admin.37224.log: 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40505.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37224.log.gz 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39588.log: /var/log/ceph/ceph-client.admin.34155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39588.log.gz 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34280.log 2024-09-15T22:58:57.461 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34280.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40505.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40663.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34280.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34700.log: /var/log/ceph/ceph-client.admin.36022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37064.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40663.log.gz/var/log/ceph/ceph-client.admin.37064.log: 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36152.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-09-15T22:58:57.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38963.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36672.log: /var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37905.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37408.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38963.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37905.log: /var/log/ceph/ceph-client.admin.37408.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37905.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34804.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37408.log.gz 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40583.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40141.log 2024-09-15T22:58:57.463 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40583.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34804.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40583.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35197.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40453.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40141.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39251.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35817.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.39251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35197.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39558.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35817.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.0.39251.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.38017.log 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39558.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39558.log.gz 2024-09-15T22:58:57.464 INFO:teuthology.orchestra.run.smithi028.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.38017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35639.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35639.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35639.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34388.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr: 90.9%/var/log/ceph/ceph-client.admin.35008.log: -- replaced with /var/log/ceph/ceph-client.0.38017.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38789.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38989.log 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34388.log: /var/log/ceph/ceph-client.admin.38789.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34388.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38789.log.gz 2024-09-15T22:58:57.465 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-09-15T22:58:57.466 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T22:58:57.475 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40113.log 2024-09-15T22:58:57.475 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38989.log: /var/log/ceph/ceph-client.admin.34805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37003.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38989.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40113.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37003.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36614.log: /var/log/ceph/ceph-client.admin.34752.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40323.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35009.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3%/var/log/ceph/ceph-client.admin.40323.log: -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-09-15T22:58:57.476 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40323.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35009.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35009.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37596.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36458.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7%/var/log/ceph/ceph-client.admin.37596.log: -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37596.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36458.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36458.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36243.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38397.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0%/var/log/ceph/ceph-client.admin.36243.log: -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36243.log.gz 2024-09-15T22:58:57.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38397.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38397.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37120.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4%/var/log/ceph/ceph-client.admin.37120.log: -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37120.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29033.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36126.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.29033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36432.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29033.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36126.log: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36126.log.gz 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-15T22:58:57.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38640.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5%/var/log/ceph/ceph-client.admin.36536.log: -- replaced with /var/log/ceph/ceph-client.admin.36432.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37935.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38640.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38640.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35428.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36920.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39041.log 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36048.log: /var/log/ceph/ceph-client.admin.36920.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-09-15T22:58:57.479 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36920.log.gz 2024-09-15T22:58:57.484 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38763.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5%/var/log/ceph/ceph-client.admin.40375.log: -- replaced with /var/log/ceph/ceph-client.admin.39041.log.gz 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38763.log.gz 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40297.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz/var/log/ceph/ceph-client.admin.40297.log: 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40297.log.gz 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40531.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-09-15T22:58:57.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38529.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1%/var/log/ceph/ceph-client.admin.34596.log: -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38529.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38529.log.gz 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37198.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35005.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8%/var/log/ceph/ceph-client.admin.37198.log: -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40479.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37198.log.gz 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35005.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35005.log.gz 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39946.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6%/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-15T22:58:57.486 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40479.log.gz 2024-09-15T22:58:57.487 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39946.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39946.log.gz 2024-09-15T22:58:57.487 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35007.log 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35007.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35007.log.gz 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37250.log 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-09-15T22:58:57.489 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36297.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-09-15T22:58:57.490 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T22:58:57.490 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38581.log 2024-09-15T22:58:57.490 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.a.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37250.log.gz 2024-09-15T22:58:57.494 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38170.log 2024-09-15T22:58:57.495 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38581.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38581.log.gz 2024-09-15T22:58:57.495 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-15T22:58:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38170.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38170.log.gz 2024-09-15T22:58:57.497 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39993.log 2024-09-15T22:58:57.498 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-15T22:58:57.498 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35912.log 2024-09-15T22:58:57.499 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39993.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39993.log.gz 2024-09-15T22:58:57.499 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28917.log 2024-09-15T22:58:57.501 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.2.35912.log: 89.8% -- replaced with /var/log/ceph/ceph-client.2.35912.log.gz 2024-09-15T22:58:57.501 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-09-15T22:58:57.502 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.28917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28917.log.gz 2024-09-15T22:58:57.503 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39842.log 2024-09-15T22:58:57.504 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36737.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-09-15T22:58:57.504 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34803.log 2024-09-15T22:58:57.505 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39842.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39842.log.gz 2024-09-15T22:58:57.505 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40045.log 2024-09-15T22:58:57.506 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34803.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34803.log.gz 2024-09-15T22:58:57.507 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2024-09-15T22:58:57.508 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40045.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40045.log.gz 2024-09-15T22:58:57.508 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-15T22:58:57.509 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36380.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2024-09-15T22:58:57.509 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34440.log 2024-09-15T22:58:57.510 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36588.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-15T22:58:57.511 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35221.log 2024-09-15T22:58:57.512 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34440.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34440.log.gz 2024-09-15T22:58:57.512 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2024-09-15T22:58:57.513 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35221.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35221.log.gz 2024-09-15T22:58:57.513 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36185.log 2024-09-15T22:58:57.514 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37732.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2024-09-15T22:58:57.515 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35480.log 2024-09-15T22:58:57.515 INFO:teuthology.orchestra.run.smithi028.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-15T22:58:57.515 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36185.log: 90.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T22:58:57.516 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36185.log.gz 2024-09-15T22:58:57.516 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34806.log 2024-09-15T22:58:57.517 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38300.log 2024-09-15T22:58:57.517 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8%/var/log/ceph/ceph-client.admin.34806.log: -- replaced with /var/log/ceph/ceph-client.admin.35480.log.gz 2024-09-15T22:58:57.517 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38737.log 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34806.log.gz/var/log/ceph/ceph-client.admin.38300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34801.log 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38300.log.gz 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38737.log.gz 2024-09-15T22:58:57.518 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35220.log 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34801.log: /var/log/ceph/ceph-client.admin.36946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34995.log 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34801.log.gz 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37356.log 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35220.log.gz 2024-09-15T22:58:57.520 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34995.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.39644.log 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37356.log: /var/log/ceph/ceph-client.admin.39391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37356.log.gz 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.39644.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38423.log 2024-09-15T22:58:57.522 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36816.log: /var/log/ceph/ceph-client.admin.38423.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38423.log.gz 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.0.39644.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36789.log 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.39195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz 2024-09-15T22:58:57.524 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36789.log.gz 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36868.log 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7%/var/log/ceph/ceph-client.admin.39816.log: -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz/var/log/ceph/ceph-client.admin.36868.log: 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0%/var/log/ceph/ceph-client.admin.39334.log: -- replaced with /var/log/ceph/ceph-client.admin.36868.log.gz 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37819.log 2024-09-15T22:58:57.527 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2024-09-15T22:58:57.528 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2024-09-15T22:58:57.528 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.37819.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2024-09-15T22:58:57.528 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38352.log 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40019.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gz 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40635.log 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38352.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.37819.log.gz 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33697.log 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38352.log.gz/var/log/ceph/ceph-client.admin.40635.log: 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33697.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40635.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37276.log 2024-09-15T22:58:57.531 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33697.log.gz 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36975.log 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28808.log 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37276.log: /var/log/ceph/ceph-client.admin.36975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40219.log 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37276.log.gz 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.28808.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36975.log.gz 2024-09-15T22:58:57.532 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-09-15T22:58:57.534 INFO:teuthology.orchestra.run.smithi028.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.28808.log.gz 2024-09-15T22:58:57.534 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-09-15T22:58:57.534 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40219.log: /var/log/ceph/ceph-client.admin.39119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.40167.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40219.log.gz 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35010.log: /var/log/ceph/ceph-client.admin.34674.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34492.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-09-15T22:58:57.535 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-09-15T22:58:57.543 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T22:58:57.570 INFO:teuthology.orchestra.run.smithi028.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T22:58:57.594 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T22:58:57.618 INFO:teuthology.orchestra.run.smithi028.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T22:58:57.621 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T22:58:57.626 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T22:58:57.627 INFO:teuthology.orchestra.run.smithi028.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T22:58:57.632 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T22:58:57.643 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T22:58:57.645 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-09-15T22:58:57.645 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m0.229s 2024-09-15T22:58:57.645 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m1.032s 2024-09-15T22:58:57.645 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m0.053s 2024-09-15T22:58:57.660 INFO:teuthology.orchestra.run.smithi028.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T22:58:57.663 INFO:teuthology.orchestra.run.smithi028.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T22:58:57.665 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-15T22:58:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m0.287s 2024-09-15T22:58:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m1.333s 2024-09-15T22:58:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m0.118s 2024-09-15T22:58:57.665 INFO:tasks.ceph:Archiving logs... 2024-09-15T22:58:57.665 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi028/log 2024-09-15T22:58:57.666 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:58:57.994 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi131/log 2024-09-15T22:58:57.995 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:58:58.116 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:58:58.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:58:58.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:58:58.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:58:58.203 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:58:58.214 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:58:58.214 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:58:58.217 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 77 0.117 -2.217 1.529 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout:+hv02.front.sepi 96.245.170.99 3 u 57 64 77 0.111 -0.062 1.539 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout:*hv03.front.sepi 74.6.168.72 3 u 48 64 77 0.135 -0.973 1.503 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:58:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:58:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-09-15T22:58:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:+hv01.front.sepi 67.205.162.81 3 u 48 64 77 0.089 -2.199 1.531 2024-09-15T22:58:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:+hv02.front.sepi 96.245.170.99 3 u 48 64 77 0.104 -2.360 2.454 2024-09-15T22:58:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:*hv03.front.sepi 74.6.168.72 3 u 52 64 77 0.136 +0.390 2.489 2024-09-15T22:58:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:58:58.231 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:58:58.241 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:58:58.242 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:58:58.252 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:58:58.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:58:58.276 INFO:teuthology.task.internal:Duration was 845.206514 seconds 2024-09-15T22:58:58.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:58:58.288 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:58:58.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:58:58.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:58:58.329 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:58:58.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-09-15T22:58:58.329 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:58:58.380 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-09-15T22:58:58.380 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:58:58.390 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:58:58.390 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:58:58.423 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:58:58.460 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:58:58.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:58:58.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:58:58.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:58:58.575 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:58:58.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:58:58.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:58:58.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:58:58.612 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:58:58.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:58:58.640 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-09-15T22:58:58.655 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-09-15T22:58:58.667 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:58:58.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:58.698 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:58:58.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:58.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:58:58.723 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:58:58.724 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi028 2024-09-15T22:58:58.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:58:58.763 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906279/remote/smithi131 2024-09-15T22:58:58.763 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:58:58.785 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:58:58.785 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:58:58.803 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:58:58.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:58:58.841 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:58:58.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:58:58.859 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:58:58.860 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:58:58.862 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:58:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: 658632 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:58 /home/ubuntu/cephtest 2024-09-15T22:58:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: 658632 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:58 /home/ubuntu/cephtest 2024-09-15T22:58:58.878 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:58:58.889 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:58:58.917 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} duration: 845.2065141201019 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:58:58.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:58:58.994 INFO:teuthology.run:pass